Supervision works best when it starts where the supervisee actually is: their skills, their cultural background, and the setting they work in.
Why it matters
Every supervisee arrives with a different history. One new RBT has classroom experience but has never taken partial-interval data; a trainee may write strong programs but freeze when giving caregivers feedback. Skip the assessment and you are guessing, usually toward your own interests rather than the supervisee's needs.
Assessment-based goals also protect clients: you are responsible for the services supervisees deliver, so you need data showing they implement procedures correctly. Expect vignettes on what to do before writing goals, which goal comes first, how culture or the setting changes a goal, and what to do when observation and self-report disagree.
Key ideas
- Assess first, then set goals. Collect baseline data on the skills the supervisee's role requires before deciding what to train.
- Use more than one source. Strong assessments combine:
- Direct observation of real sessions scored with a competency checklist.
- Work-product review: session notes, data sheets, graphs, written programs.
- Role-play skill checks for procedures that rarely come up, such as a crisis plan.
- Self-assessment of strengths, confidence, and career interests.
- Assess the professional skills too. Receiving feedback, time management, and communicating with caregivers belong in the assessment alongside technical skills.
- Assess the context, not only the person. Cultural variables include the supervisee's language, communication norms, and views on feedback and authority, plus the cultures of the families they serve. Environmental variables include the setting (clinic, home, school), caseload, schedule, materials, and how often you can observe. Both shape which goals make sense and how each is written.
- Write goals the way you write client goals. Each goal names an observable skill, the conditions, and a mastery criterion, so both of you can tell when it is met.
- Prioritize. Client safety and ethical obligations come first, then core role skills, then prerequisites for complex skills, then career growth.
- Set goals together. Review the results, explain what you saw, and agree on goals and timelines. Shared goals build buy-in.
- Revisit regularly. Reassess as goals are met, as the caseload changes, or as performance data shift.
Definitions
- Supervisee assessment: a structured evaluation of a supervisee's current performance on role-required skills, used to set baseline and select goals.
- Competency checklist: a task-analyzed list of a skill's steps, scored during observation.
- Baseline: performance on a skill before training begins, used to judge progress.
- Supervision goal: an observable, measurable statement of a skill the supervisee will perform, under stated conditions, to a stated criterion.
- Mastery criterion: the performance level that shows a goal is met, such as 90% of checklist steps correct across two consecutive observed sessions.
- Cultural variables: features of a person's background, such as language, values, and communication norms, that affect how they learn, receive feedback, and work with families.
- Environmental variables: features of the work setting, such as caseload, schedule, materials, and competing duties, that affect whether a supervisee performs skills they already have.
- Skill deficit vs. performance deficit: a skill deficit means the person cannot perform the skill even under ideal conditions; a performance deficit means they can, but do not do it reliably on the job.
Examples from a session
From assessment to goals
Setting: Aisha, a BCBA at a community clinic, begins supervising Marco, a newly certified RBT who works with a 6-year-old in the clinic and a 15-year-old at home.
- Observation: Aisha scores Marco's discrete-trial teaching with a checklist. He scores 70%, mostly missing the correction procedure.
- Work products: His session notes are accurate but often submitted two days late.
- Role-play: He correctly rehearses the teen's crisis plan, but hesitates on when to call for help.
- Self-assessment: Marco feels unsure talking with caregivers and wants to learn more about adolescent programs.
- Context: The teen's family prefers Spanish for caregiver updates, and Marco is bilingual. His late notes began when his caseload doubled last month.
Goals they agree on, in priority order:
- State and follow every step of the crisis plan in role-play at 100% accuracy across two checks.
- Implement the correction procedure at 90% or more of checklist steps across two consecutive observed sessions.
- Submit session notes within 24 hours for four consecutive weeks.
- Lead a 5-minute caregiver update in Spanish using a provided outline, meeting all outline items, in two sessions.
Aisha did not retrain skills Marco already showed, such as data recording. Because his notes were accurate and the delay began with the bigger caseload, she also blocked 15 minutes for notes after each home session instead of training note writing.
Non-example: A supervisor gives every new RBT the same ten goals from the job description on day one, without observing anyone. Measurable, perhaps, but not selected from an assessment.
Common mistakes / exam traps
- Writing goals before assessing. When a stem asks what to do first, gather baseline data before any training.
- Relying on one data source. Self-report alone over- or underestimates skill; one observation can miss rare skills.
- Vague goals. "Become more confident" or "understand discrete-trial teaching better" cannot be measured. "Attend three trainings" is measurable, but it describes an activity, not a performance outcome.
- Ignoring priorities. A report-style goal should not come before a gap in a client's safety procedure.
- Training what is not a skill problem. If the supervisee performs a skill correctly under some conditions but not others, more training may not help. Look at the work environment (materials, workload, feedback) instead.
Exam trap
When the supervisee's self-rating and your observation data disagree, do not simply pick one. Share the specific data, discuss the difference, and set the goal together based on what was observed.
Exam trap
Cultural variables change how a goal is written and practiced, not whether a needed goal exists. Dropping a goal "out of respect" and imposing one in a form that clashes with the supervisee's norms are both wrong; agree on a form that fits.
Quick check
Lin, a BCBA, has just started supervising Rosa, an RBT who transferred from another agency. Rosa says she is already fluent in all of the agency's procedures. What should Lin do before setting supervision goals?
Related topics
- Building effective supervisory relationships (I.2)
- Promoting equity in supervision (I.3)
- Evidence-based, culturally responsive performance management (I.5)
- Function-based performance diagnostics for staff (I.6)
- Evaluating supervision practices with data (I.7)
- Writing intervention goals in observable, measurable terms (H.1)