Assessment Methodology & Quality Assurance

Assessment Protocol

The Selsine Standard mandates rigorous, multi-visit assessment protocols to ensure reliability and validity:

Minimum visit requirements:

• Two independent assessments for initial certification consideration
• Three or more visits for higher certification tiers (as defined by licensee)
• All assessments conducted anonymously without venue notification
• Full commercial rates paid; no complimentary service accepted
• Assessments distributed across different dayparts, party sizes, and seasons when feasible

Documentation standards:

• Structured evaluation rubric completed within 12 hours of visit
• Photographic documentation (food, ambiance) where permitted
• Receipt retention and expense verification
• Detailed narrative observations supplementing quantitative scores

Scoring Algorithm

Each trained assessor assigns criterion-specific sub-scores (0–10 scale) across all nine dimensions. The weighted algorithmic model produces visit-level scores, which are then aggregated using temporal weighting to generate venue-level assessments.

The multi-visit aggregation model balances historical performance with current quality, ensuring scores reflect both consistency and evolution.

Inter-Rater Reliability

The Standard employs rigorous calibration protocols to maintain consistency across assessors:

Variance thresholds:

• When assessor scores differ by >5 points, additional assessment and committee review required
• Systematic variance patterns trigger assessor recalibration

Calibration measures:

• Quarterly calibration sessions with reference venue assessments
• Blind scoring exercises to measure inter-rater agreement
• Statistical monitoring for assessor drift
• Mandatory retraining when reliability metrics fall below threshold

Committee Review Process

Organizations implementing the Standard establish review committees to oversee certification decisions:

Committee protocols:

• Minimum three qualified members for certification decisions
• Mandatory conflict-of-interest disclosures
• Documented decision rationale with audit trails
• Annual review of borderline cases and appeals
• Statistical analysis of committee decision patterns

Independence & Conflict of Interest

The Standard mandates strict independence protocols:

Assessor restrictions:

• No financial interest in assessed venues
• No acceptance of gifts, discounts, or preferential treatment
• No consulting or advisory services to venues under assessment
• No disclosure of assessor role or affiliation to venues
• Recusal from assessments where personal relationships exist

Organizational independence:

• Separation between standards development and commercial implementation
• No pay-for-certification models
• Transparent governance structures
• Public disclosure of funding sources and partnerships