Author: Nathan Veil (Applied Coherence Institute)
Date: May 12, 2026
Classification: Psychometrics / Behavioral Assessment / Multi-Method Measurement
Document Type: Instrument Development / Observer-Report Protocol (Proposed)
Status Notice
| Status | This paper describes a proposed observer‑report instrument for the Coherence Metrics Framework. No empirical validation has been conducted. All items, scoring protocols, and psychometric targets are proposed for future validation studies. |
|---|
Abstract
The Coherence Profile (CP-100, CP-25) relies on self‑report. This paper introduces the Coherence Profile – Observer Report (CP-O) , a multi‑domain instrument for observer assessment of regulatory stability. The CP-O is designed for completion by peers, family members, partners, or supervisors who know the target individual well. It parallels the self‑report CP-25 structure, with 25 items across five domains (physiological, cognitive, behavioral, relational, environmental), but rephrases items into observable behaviors. The paper presents: (1) theoretical rationale for observer assessment, (2) item mapping from self‑report to observer version, (3) proposed administration protocols, (4) observer selection guidelines, (5) ethical constraints, (6) proposed psychometric targets (inter‑rater reliability, self‑observer agreement, differential item functioning), and (7) integration with multi‑trait multi‑method (MTMM) validation. The CP-O is offered as a research instrument for future validation.
Keywords: observer report, multi‑method assessment, regulatory stability, inter‑rater reliability, MTMM, coherence measurement
1. Introduction
Self‑report measures have inherent limitations:
| Limitation | Description |
|---|---|
| Self‑presentation bias | Respondents may present idealized versions of themselves |
| Limited self‑awareness | Individuals may lack insight into their own regulatory patterns |
| Reference frame variation | Different individuals use different internal standards |
| Common method variance | Self‑report only correlations inflated by shared method |
Observer reports mitigate these limitations by providing external, behavioral‑anchored assessment. The Coherence Profile – Observer Report (CP-O) is designed for this purpose.
Status Note: This is a proposed instrument. No empirical validation has been conducted.
2. Theoretical Rationale
2.1 Why Observer Report for Coherence?
| Domain | Observable Indicators | Non‑Observable (Self‑Report Only) |
|---|---|---|
| Physiological | Physical energy, fatigue level, visible tension | Internal bodily sensations |
| Cognitive | Task persistence, distractibility, follow‑through | Internal attentional experience |
| Behavioral | Commitment keeping, reliability, punctuality | Internal values‑action alignment |
| Relational | Conflict frequency, social withdrawal, interpersonal warmth | Internal felt safety |
| Environmental | Organization, time management, response to procedures | Internal sense of predictability |
Observers can reliably report on observable behaviors. Internal states require self‑report. The CP-O focuses on the observable.
2.2 Complementary Role
| Assessment | Function |
|---|---|
| Self‑report (CP-25) | Internal experience; subjective coherence |
| Observer report (CP-O) | External behavior; observable regulatory stability |
| Physiological (HRV) | Objective biological indicator |
| Behavioral logs | Time‑sampled observable behavior |
Multi‑method triangulation strengthens construct validity.
3. Item Mapping: Self‑Report to Observer Version
3.1 Item Transformation Principles
| Principle | Self‑Report Example | Observer Example |
|---|---|---|
| Change pronoun | “I can focus without distraction” | “This person can focus without distraction” |
| Externalize internal states | “My body feels calm” | “This person appears calm and relaxed” |
| Specify observability | “I feel understood” | “This person seems to feel understood in conversations” |
| Avoid mind‑reading | “I am reliable” | “This person follows through on commitments” |
| Contextualize | “My environment is predictable” | “This person’s environment appears predictable” |
3.2 CP-O Item Set (Proposed)
Physiological Coherence (P‑O)
| Item | Self‑Report Source |
|---|---|
| “This person appears calm and at ease.” | P‑S1 (I feel calm) |
| “This person shows signs of physical tension.” | P‑S2 (reverse of felt tension) |
| “This person seems to have steady, relaxed energy.” | P‑T3 (breathing is steady) |
| “This person appears tired or depleted.” | P‑T4 (reverse of recovery) |
| “This person recovers quickly after stress (observably).” | P‑T8 |
Cognitive Coherence (C‑O)
| Item | Self‑Report Source |
|---|---|
| “This person can focus without obvious distraction.” | C‑T1 |
| “This person’s mind seems to wander.” | C‑S2 |
| “This person completes tasks without switching.” | C‑S3 |
| “This person’s attention is pulled in many directions.” | C‑T4 |
| “This person returns to focus after interruption.” | C‑T7 |
Behavioral Coherence (B‑O)
| Item | Self‑Report Source |
|---|---|
| “This person does what they say they will do.” | B‑T1 |
| “This person fails to follow through on commitments.” | B‑S2 |
| “This person’s actions match their stated values.” | B‑T3 |
| “This person acts in ways they later regret (observably).” | B‑S4 |
| “Others would describe this person as reliable.” | B‑T5 (observer version) |
Relational Coherence (R‑O)
| Item | Self‑Report Source |
|---|---|
| “This person seems safe in close relationships.” | R‑S1 |
| “This person experiences draining conflict.” | R‑S2 |
| “This person seems understood by others close to them.” | R‑S3 |
| “This person appears alone even when with others.” | R‑T4 |
| “This person recovers quickly after a disagreement.” | R‑T8 |
Environmental Coherence (E‑O)
| Item | Self‑Report Source |
|---|---|
| “This person’s environment appears predictable.” | E‑T1 |
| “This person’s surroundings seem chaotic.” | E‑S2 |
| “The institutions this person deals with seem transparent (observer inference).” | E‑T3 (modified) |
| “This person encounters unexpected obstacles from organizations.” | E‑T4 |
| “This person can find needed information when required.” | E‑S5 |
Note: Environmental items are the most inferential. Observers may have limited access to institutional interactions. These items should be used cautiously or omitted in some contexts.
4. Proposed Administration Protocols
4.1 Observer Types
| Observer Type | Typical Relationship | Recommended Use |
|---|---|---|
| Peer | Friend, colleague, classmate | General behavioral assessment |
| Family member | Partner, parent, adult child | Relational and behavioral assessment |
| Partner / spouse | Intimate partner | Relational coherence (most informative) |
| Supervisor / manager | Work supervisor (with consent) | Behavioral and cognitive assessment at work |
| Clinician / researcher | Trained observer | Research reliability studies |
4.2 Administration
| Parameter | Specification |
|---|---|
| Format | Paper or electronic (same as CP-25) |
| Response scale | 5‑point Likert (1 = Strongly disagree to 5 = Strongly agree) |
| Time | 5‑10 minutes |
| Prerequisite | Observer must know target for at least 3 months |
| Context | Observer completes independently; no consultation with target |
4.3 Observer Instructions
“Please rate the person you are observing based on their observable behavior over the past month. Do not guess about their internal experiences. If you have not observed a behavior, rate based on your best estimate or leave blank. Please answer independently; do not discuss your ratings with the person you are observing.”
5. Observer Selection Guidelines
| Criterion | Requirement |
|---|---|
| Familiarity | Minimum 3 months of regular interaction (at least weekly) |
| Independence | Observer should not be coached by target |
| Multiple observers | Ideally 2‑3 observers per target for reliability estimation |
| Relationship type | Document relationship (peer, family, partner, supervisor) |
| Conflict of interest | Observers should not be in active conflict with target (may bias ratings) |
6. Ethical Constraints
| Constraint | Rationale |
|---|---|
| Separate consent | Observer provides independent informed consent |
| No coercion | Observer participation voluntary; refusal does not affect target’s participation |
| Scope limitation | Observer reports only observable behavior, not inferred internal states |
| Confidentiality | Observer data linked to target but not shared with target without consent |
| Non‑punitive use | Observer data not used for employment, insurance, or punitive decisions |
| Right to withdraw | Observer may withdraw at any time; data retained or deleted per consent |
| Observer burden | Observers should not complete more than 3‑5 CP‑O assessments at once |
7. Proposed Scoring
| Score | Calculation |
|---|---|
| Domain score | Mean of 5 items in domain (1‑5) |
| Total score | Mean of all 25 items (1‑5) |
| Interpretation | Same as CP-25 (1‑5 scale) |
Proposed caution: Low observer‑target agreement does not necessarily indicate target inaccuracy; observers may lack access to relevant information.
8. Proposed Psychometric Targets
8.1 Inter‑Rater Reliability
| Statistic | Target | Interpretation |
|---|---|---|
| ICC (between two observers) | > 0.70 | Acceptable agreement |
| ICC (between three observers) | > 0.75 | Good agreement |
| Correlation between observers | r > 0.60 | Moderate agreement |
8.2 Self‑Observer Agreement
| Statistic | Target | Interpretation |
|---|---|---|
| Self‑observer same‑domain correlation | r > 0.40 | Moderate convergence (expected; methods differ) |
| Self‑observer total correlation | r > 0.50 | Moderate convergence |
| Domain‑specific self‑observer correlations | Variable | Physiological: r > 0.30; Behavioral: r > 0.50 (most observable) |
Note: Low self‑observer agreement is not a validity failure; it reflects method differences. Self reports internal experience; observers report external behavior.
8.3 Differential Item Functioning (DIF)
| Comparison | DIF Tolerance |
|---|---|
| Observer type (peer vs. partner) | No substantial DIF |
| Gender of observer | No substantial DIF |
| Relationship duration | No substantial DIF |
8.4 Factor Structure
| Model | Expected Fit |
|---|---|
| 5‑factor (correlated domains) | Acceptable (CFI > 0.90, RMSEA < 0.08) |
| Bifactor (general + domain factors) | Better (if general coherence emerges from observer data) |
9. Integration with MTMM Validation
| Trait | Self‑Report (CP-25) | Observer Report (CP-O) | Physiological (HRV) | Behavioral (Logs) |
|---|---|---|---|---|
| Physiological | ✓ | ✓ (external signs) | ✓ | — |
| Cognitive | ✓ | ✓ (attention, persistence) | — | ✓ (task‑switching logs) |
| Behavioral | ✓ | ✓ (commitment, reliability) | — | ✓ (commitment logs) |
| Relational | ✓ | ✓ (conflict, warmth) | — | — |
| Environmental | ✓ | ✓ (limited) | — | — |
Proposed MTMM predictions:
| Comparison | Expected Correlation |
|---|---|
| Monotrait‑heteromethod (same domain, different observer) | r > 0.40 |
| Heterotrait‑monomethod (different domains, same observer) | r < 0.35 |
| Heterotrait‑heteromethod (different domains, different methods) | r < 0.25 |
10. Planned Validation Studies
| Study | Description | Sample | Status |
|---|---|---|---|
| 1 | Inter‑rater reliability (dyads, triads) | 100 targets × 2‑3 observers | Planned |
| 2 | Self‑observer agreement | 200 targets + 200 observers | Planned |
| 3 | MTMM validation (self + observer + HRV + logs) | 100 triads | Planned |
| 4 | Known‑groups (coherence practitioners vs. general) | 100 per group + observers | Planned |
| 5 | Test‑retest (observer stability over 2 weeks) | 100 observers | Planned |
11. Limitations
| Limitation | Mitigation |
|---|---|
| No empirical validation yet | Proposed instrument; validation studies required |
| Observer access limitations | Not all domains equally observable (physiological, environmental) |
| Relationship effects | Friends may rate differently than partners; document relationship type |
| Observer bias | Positive or negative halo effects possible; multiple observers recommended |
| Cultural variation | Observability norms may vary across cultures |
| Self‑observer disagreement is expected | Not a validity failure; reflects method differences |
12. Relationship to CP-25 and CP-100
| Instrument | Source | Use |
|---|---|---|
| CP-100 (self) | Target | Deep assessment (100 items) |
| CP-25 (self) | Target | Brief screening, longitudinal tracking |
| CP-O (observer) | Observer (peer, family, partner) | Multi‑method validation, external behavioral assessment |
The CP-O does not replace self‑report. It complements it.
13. Comparison with Self‑Report Items
| Domain | Self‑Report (Internal) | Observer (External) |
|---|---|---|
| Physiological | “My body feels calm” | “This person appears calm” |
| Cognitive | “I can focus without distraction” | “This person focuses without obvious distraction” |
| Behavioral | “I do what I say I will do” | “This person does what they say they will do” |
| Relational | “I feel safe in close relationships” | “This person seems safe in close relationships” |
| Environmental | “My environment feels predictable” | “This person’s environment appears predictable” |
14. Conclusion
The Coherence Profile – Observer Report (CP-O) is a proposed multi‑domain instrument for observer assessment of regulatory stability. It parallels the self‑report CP-25 but rephrases items into observable behaviors. The CP-O enables:
- Multi‑trait multi‑method (MTMM) validation
- Inter‑rater reliability estimation
- Self‑observer agreement assessment
- Behavioral specification of coherence domains
The instrument is offered as a research tool for future validation. It does not replace self‑report but complements it, providing external behavioral anchoring for the coherence construct.
“Observers see what we cannot see in ourselves. The CP-O is their lens.”
15. References
(Full references as in prior papers, plus observer‑report and MTMM literature)
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait‑multimethod matrix. Psychological Bulletin, 56(2), 81‑105.
Connelly, B. S., & Ones, D. S. (2010). Another perspective on personality: Meta‑analytic integration of observers’ accuracy and predictive validity. Psychological Bulletin, 136(6), 1092‑1122.
Vazire, S. (2010). Who knows what about a person? The self‑other knowledge asymmetry (SOKA) model. Journal of Personality and Social Psychology, 98(2), 281‑300.
End of Paper
Leave a Reply