Lecture
Lecture questions:
1. Features of the procedure
expert evaluation
2. Examination
3. Method of assessing the level of quality
in points
1. Features of the peer review procedure
The object of examination (expert assessments) of industrial
products may be individual consumer properties or
their totality.
Criteria for the quality examination,
are divided into general and specific.
Common criteria include established ones
value orientations, ideas and norms. Specific
The criteria for the expert are real requirements for the quality of the product.
Ducts of this type, established in the regulatory and technical
other mandatory documents. In the form of
specific criteria are also a set of basic values
indicators of the properties characterizing the planned or project
the products being marketed. Characteristics of real-life
high-quality products manufactured in the country or for
overseas, are also specific criteria for experts.
In order to increase reliability, accuracy, reliability
reproducibility of expert assessments;
through group decision making by competent
by people. To assess the level of product quality, an ex-
Perth commission consisting of expert and working groups
The expert group includes highly qualified
personal and specially trained workers in the field of
and the functioning of the product being evaluated: researchers,
designers, technologists, designers, commodity scientists, economists and
etc. The number of experts in the group depends on the required
the accuracy of the average estimates and should be from seven to twenty
ty man In absentee polling, the upper limit of the number of
Experts are not limited.
The expert group (commission) enjoys expert advice
information on quality indicators
my products. In this case, the expert group can take
decisions based on averaging expert ratings or by conducting
expert voting (“commission” method). In order to reduce
subjectivity in the expert method, it is recommended
several rounds of polls experiments.
The expert method of “commissions” is that in
It is used as a vote. First assessment
experts independently. Then, after the open
discussion of the ratings, experts again, independently
from each other give an assessment of each object. Subsequently
adjusted individual estimates calculated
peer review. This work is carried out by a working group of ex-
pertnoy commission. In addition, the working group organizes
expert survey, analyzes the results obtained and
draws up the conclusion of the expert committee.
It is recommended that for assessing similar products
the expert committee was composed of permanent experts and
members of the working group. This is desirable because in the process
work on a standing commission accumulates experience
work, training of its members takes place, general
approaches and principles, and this increases work efficiency
expert committee.
The list and sequence of the main stages of work
The expert committee is as follows:
- appointing persons responsible for organizing and inspecting
The performance of expert evaluation of product quality;
- formation of expert and working groups;
- development of classification and definition of nomenclature
quality indicators of the evaluated products;
- preparation of questionnaires and explanatory notes for the survey
experts;
- Evaluation and expert survey;
- processing expert assessments;
- analysis and presentation of the results of expert evaluation of
quality (or quality indicators) of products.
In the practice of expert assessment of quality, in particular when
expert assessment of consumer properties of products, mainly
Mr. apply complex and operational expertise.
Comprehensive examination is carried out for comprehensive
study and assess the quality of groups of homogeneous products,
commercially serialized. In this regard, with expert
They implement a systematic, integrated approach to the analysis and
product evaluation. With a comprehensive examination receive
not only a more complete characterization of the object being evaluated,
but also a certain scientific, methodical and regulatory material
Rial used for other types of expertise.
Operational expertise is based on data obtained
during the previous comprehensive examinations.
This technique can significantly reduce the volume and time of the ex-
perth work with sufficient depth and validity of ex-
pert conclusions
2. Examination
There are two main methods of expert assessments:
Todd Delphi and Pattern Method.
Delphi method. Minimum number of experts allowed:
5-7. Its peculiarity is that the expert expresses his
the judgment is not during the group discussion, but sets it out in
a practical questionnaire with detailed instructions.
Existing varieties of the Delphi method are based on
that the study of the problem is divided into several stages (
ditch). Each stage involves the following procedures.
- Splitting the question into several aspects, allowing
consider the problem from different angles.
- Selection to resolve the issue in each round of various
combinations of experts:
- The same group of experts is used in all rounds.
- The main core of the group of experts with
the existence of some and the inclusion of others.
- Use at each stage of the new group of experts.
Advantages of the Delphi method:
1) the possibility of obtaining exclusive opinions,
free and independent of external circumstances;
2) high objectivity of judgments;
3) convenience, simplicity and efficiency.
Cons Delphi method:
1) when conducting a survey in more than one round,
There is no data matching problem;
2) the bulkiness of explanatory notes to the questionnaires;
3) the complexity of filling out forms.
Method Pattern (1962-1964). Minimum allowable
the number of experts is 20. Its peculiarity is: a) the collective
new discussion of the problem; consciously creates an atmosphere of mutual
many experts influence each other; b) the problem is not easy
subjected to dismemberment to build a hierarchical tree
goals, and broken down into key and auxiliary problems and
for collective consideration choose a few nodal
questions (no more than 10).
Advantages of the Pattern method:
1) speed of data acquisition;
2) the possibility of obtaining original answers due
brainstorming;
3) Low complexity of filling out forms.
Cons of the Pattern method:
1) insufficient development and certainty of the principle
building a tree of goals, identifying individual key issues;
2) no barriers against conformism
(exposure to the opinions of others) experts;
3) the possibility of distorting the valid opinions of ex-
pertov under the influence of the emotional factor, suggestion,
expert status and adaptation to the opinion of the majority of ex-
Perth;
4) lack of elaboration of the method of selection in the expert
a group of specialists most suitable for this purpose;
5) the problem of justifying the number of experts in the group
3. Method of assessing the level of quality in points
In the examination of product quality, the most frequently used
scoring points. The scores are given directly
but experts or obtained as a result of the formalization of pro-
evaluation process. This formalization is heuristic or
experimental.
The direct appointment of scoring performance
experts independently or in the process of discussion
waiting The number of points in the estimated rating scale can
It can be different. For the evaluation of quality indicators usually
use 5, 7 and 10-point scales.
The generalized quality indicator determined by the expert
using the numerical method according to the scoring system of calculations, is found as
The arithmetic average of the estimates made by all
experts, i.e. calculated by the formula:
a
Q
i
i1
K
,
the ex
a
where a is the number of experts;
i
Q
- marks in points, set by experts.
If during the examination of quality spend a few rounds
surveys, in this case the value of the quality indicator is determined by
as the arithmetic mean of the estimates obtained
in each round of the survey of experts on the expression:
m
K
exi
'
i1
K
the ex
,
t
Where
Keks.
- the value of the quality indicator obtained in each round;
i
t is the number of survey rounds.
In cases where individual quality indicators are non-
equally affect the overall level, it is advisable to use
weight coefficients:
a
q i m
i
i1
K
,
the ex
t
where m i is the weight coefficient of the i- th single quality indicator
The expert method is often used when choosing technical equipment.
ki submitted by several enterprises for tender
contests (bidding).
Heuristic formalization of expert assessments
determination of the relationship between the values of the parametric
scores and their scores. Based on this
plotted or developed (written) mathematical
formula that allows you to express the score show
quality bodies in physical units.
In experimental formalization, it is established that
ratio of scoring values with values of
Lei, determined by the experiment. This method is
It is more objective.
There is also the so-called sociological method.
product quality assessment. This method, like the expert one, is based
van on polls, on opinions, but not on special experts, but on
personal consumers of the evaluated products. Therefore, the social
The logical method refers to a variety of expert. Collection
Consumer opinions are produced by interviewing or using
spaces and special questionnaire questionnaires,
and also by organizing conferences, exhibitions, auctions,
pilot operation, etc.
Comments
To leave a comment
Qualimetry reliability and quality
Terms: Qualimetry reliability and quality