INTRODUCTION TO REQUIRED EVALUATIONS AND LIST OF EVALUATIONS USED IN THIS RESIDENCY PROGRAM

Evaluations Utilized

  • Radiology Resident Formative Evaluation by Faculty A. Global Evaluation of Residents by Faculty
    Evaluator:
    Rotation:
    This formative evaluation form is an important component of assessing the program's educational effectiveness and the resident's educational progress. Please indicate your evaluation rating of the resident's performance during this one month rotation with respect to the established rotation goals and objectives as they apply to the resident's individual level of training.

    PATIENT CARE

    (Resident should provide compassionate, and effective care for health problems)
    1) Develops a management plan based on radiologic findings and clinical information.
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    2) Demonstrates proper technique in planning and performing image-guided procedures
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    3) Appropriately obtains informed consent
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

    MEDICAL KNOWLEDGE and CLINICAL PERFORMANCE
    (Resident should be knowledgeable, scholarly, and committed to lifetime learning)
    4) Recognizes and describes relevant radiologic abnormalities
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    5) Synthesizes radiologic and clinical information and forms a diagnostic impression
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    6) Utilizes information technology to investigate clinical questions and for continuous self-learning
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

    INTERPERSONAL/COMMUNICATION SKILLS

    (Resident should communicate and teach effectively)
    7) Shows sensitivity to and communicates effectively with all members of the health care team
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    8) Recognizes, communicates, and documents in the patient record urgent or unexpected radiologic findings
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    9) Produces radiologic reports that are accurate, concise, and grammatically correct
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    10) Effectively teaches residents, medical students and other health care professionals
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

    PRACTICE-BASED LEARNING AND IMPROVEMENT
    (Resident should investigate and evaluate patient care practices, appraise & assimilate scientific evidence in order to improve practices)
    11) Recognizes and corrects personal errors
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    12) Accepts constructive criticism
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

    PROFESSIONALISM

    (Resident should be altruistic and accountable, and adhere to principles of medical ethics by respecting and protecting patients' best interests)
    13) Demonstrates a responsible work ethic with regard to attendance and work assignments.
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    14) Demonstrates acceptable personal demeanor and hygiene.
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    15) Demonstrates responsible handling of patient medical record confidentiality
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

    SYSTEMS-BASED PRACTICE

    (Residents should understand healthcare practices)
    16) Applies appropriateness criteria and other cost-effective healthcare principles to professional practice.
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A
    17) Demonstrates diligence in following hospital/department procedures and policies
    Poor competence / Below average competence / Average competence / Above average competence / Excellent / N/A

    GENERAL
    Please provide comments regarding the resident's overall behavior: _______________________________________
    This resident has effectively met the required goals and objectives of the month's rotation as described in the
    educational curriculum. (If not, please elaborate in the comment field.)
    Yes______________________________________________ No____________________________________________
    Comments: ______________________________________________________________________________________
    If you feel comfortable, please discuss the above with the resident. Both the positive and negative.
    I have discussed this evaluation with the resident. (Please indicate date in comment field)
    Yes_________No ______N/A__________
  • Evaluation of Resident Performance by Peer B. 360 Degree Evaluations
    Evaluator:
    Subject:
    Credentials: Radiology Resident
    Please consider the following statements while rating this Resident. Base your ratings on your personal observations.

    PATIENT CARE
    - Resident should provide patient care through safe, efficient, appropriately utilized, quality-controlled radiology techniques and effectively communicates results to the referring physician and/or other appropriate individuals in a timely manner

    * Develops a management plan based on radiologic findings and clinical information:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Is helpful in orienting lower level residents new to the service or hospital:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Demonstrates sensitivity to a patient's cultural/social/economic issues:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Demonstrates strong sense of patient ownership and accountability:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge


    MEDICAL KNOWLEDGE - Resident should engage in continuous learning and apply appropriate state of the art diagnostic and/or interventional radiology techniques to meet the imaging needs of patients, referring physicians and the health care system

    * Recognizes and describes relevant radiologic abnormalities:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Is available to and takes time to teach lower level residents when working together:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Utilizes information technology to investigate clinical questions and for self-learning:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Performs procedures effectively:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge


    INTERPERSONAL/COMMUNICATION SKILLS - Resident should communicate effectively with patients, colleagues, referring physicians and other members of the health care team concerning imaging appropriateness, informed consent, safety issues and imaging results

    * Shows sensitivity & communicates effectively with all members of the health care team:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Effectively teaches non-radiology residents, students and other health care professionals:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Takes time to explain to lower level residents how to dictate reports:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    PRACTICE-BASED LEARNING AND IMPROVEMENT - Resident should participate in evaluation of one's personal practice utilizing scientific evidence, "Best practices" and self-assessment programs in order to optimize patient care through lifelong learning

    * Participates in Journal Club, Morbidity and Mortality, Interesting Case Conferences or QI/QA activities:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Appropriately accepts constructive criticism Without taking it personally and attempts to make improvements:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    * Is insightful into own character, being able to recognize personal errors and correct them:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    PROFESSIONALISM - Resident should commit to high standards of professional conduct, demonstrating altruism, compassion, honesty and integrity, follows principles of ethics and confidentiality, and considers religious, ethnic, gender, educational and other differences when interacting with patients and other members of the health care team

    Demonstrates a responsible work ethic including showing up on time and not leaving until the work is finished:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    Is willing to take a turn to help out when needed including being willing to switch rotations or take call if needed to cover for the other residents:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    Works professionally alongside other residents and faculty w/o complaining or gossiping:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    Manages personal stress effectively:
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge

    SYSTEMS-BASED PRACTICE - Resident should understand how the components of the local and national healthcare system functions interdependently and how changes to improve the system involve group and individual efforts

    *Dedicates time to study effectively, looks up answers to questions raised daily
    Strongly Disagree / Disagree / Neutral / Agree / Strongly Agree / Unable to Judge


    OVERALL PERFORMANCE
    How would you rate this resident overall as someone you would like to work with?
  • Radiology Resident Evaluation by either a Technologist, Ultrasonographer or Nurse B. 360 Degree Evaluations
    Resident Name:

    For each category circle a number (1-9) that you feel is appropriate.
    Clinical Knowledge: Residents should be able to explain procedures to patients in a knowledgeable fashion. Should be aware of the reason for the procedure and the clinical condition of the patient. Knowledge is consistent with level of training and has progressed since previous rotation.

    Is aware of the patient’s clinical condition, indications for possible outcomes and complications.
    9 8 7

    Understands the indication for examination and expected outcome and complications.
    6 5 4

    Unsure of reason for performing examination or possible complications.
    3 2 1


    Technical knowledge:
    Evaluation based on knowledge of procedure, machines, scanning parameters, filming, and PACS functions (pertinent to the modality you are in). Residents should be aware of radiation protection techniques including use of, collimation and appropriate reduction in fluoroscopy time to protect patient and physician.

    Shows a very thorough understanding of technical concepts. Can optimize more detailed technical settings.
    9 8 7

    Selects and utilizes material and equipment correctly. Can use the technology/machines needed, i.e. ultrasound units, fluoroscopy units, CT
    6 5 4

    Needs to improve knowledge of techniques.
    3 2 1


    Patient Care:
    Resident interaction with patients.

    Excellent bedside manner. Receives positive feedback from patients.
    9 8 7

    Good with patients.
    6 5 4

    Inappropriate with patients. Receives negative comments from patients.
    3 2 1


    Interpersonal/Communication Skills:
    Refers to ability to interact well with other members of the patient care team.

    Performs duties conscientiously and enthusiastically. Reports where and when scheduled. Works well with the technologists.
    9 8 7

    Performs duties willingly and without complaint. Generally works well with others.
    6 5 4

    Avoids duties and/or complains often. Often “disappears”.
    3 2 1


    Comments will be very much appreciated. Comments are mandatory if an unsatisfactory evaluation of 1 or 2 is given.

    Comments:






    Signature: Date:
  • Patient Survey of Resident B. 360 Degree Evaluations
    Please take a moment to evaluate the following OSUMC radiology resident.
    PHYSICAN NAME:

    Overall satisfaction (circle one; 1=very poor, 10=excellent): 1 2 3 4 5 6 7 8 9 10


    Circle below Yes or No to the questions
    :
    Introduced him/herself to you and your family: YES OR NO

    Was polite and considerate at all times: YES OR NO

    Was dressed professionally (clean, tidy, “business-like”): YES OR NO

    Behaved appropriately: YES OR NO

    Listened carefully to your concerns and questions: YES OR NO

    Explained risks and benefits of the procedure in a clear fashion: YES OR NO

    Discussed results of procedure to your satisfaction: YES OR NO

    Gave good, clear, accurate instructions for post-clinic care: YES OR NO
  • Radiology Resident Self Evaluation B. 360 Degree Evaluations
    Instructions for Self Evaluations

    1. In keeping with the ACGME Milestones initiative this evaluation rates residents on continuum of achievement.
    2. Please select the appropriate level of achievement for yourself as resident:

    Level 1: I demonstrate milestones expected of one who has had some education in diagnostic radiology.
    Level 2: I am advancing and demonstrate additional milestones.
    Level 3: I continue to advance and demonstrate additional milestones; I consistently demonstrate the majority of milestones targeted for residency.
    Level 4: I have advanced so that I now substantially demonstrate the milestones targeted for residency. This level is designed as the graduation target.
    Level 5: I have advanced beyond performance targets set for residency and I am demonstrating “aspirational” goals which might describe the performance of someone who has been in practice for several years. It is expected that only a few exceptional residents will reach this level.

    Patient Care & Technical Skills - Milestones

    PCTS 1: Consultant
    __Level 1: Uses evidence-based imaging guidelines. Appropriately uses the medical record to obtain patient information.
    __Level 2: Recommends appropriate imaging of common conditions.
    __Level 3: Recommends appropriate imaging of uncommon conditions.
    __Level 4: Integrates current research and literature with guidelines to recommend imaging.
    __Level 5: Participates in research, development, and implementation of imaging guidelines.

    PCTS 2: Competence in Procedures 1
    __Level 1: Competently performs basic procedures with minimal attending intervention.
    __Level 2: Competently performs intermediate procedures with minimal attending intervention.
    __Level 3: Competently performs advanced procedures with minimal attending intervention.

    PCTS 3: Competence in Procedures 2
    __Level 1: Recognizes and manages complications of basic procedures.
    __Level 2: Recognizes and manages complications of intermediate procedures.
    __Level 3: Recognizes and manages complications of advanced procedures.

    Medical Knowledge – Milestones

    MK1: Protocol selection and optimization of images
    __Level 1: Selects appropriate protocols for basic imaging, including on-call protocols.
    __Level 2: Selects appropriate protocols for intermediate imaging.
    __Level 3: Selects appropriate protocols for advanced imaging. Demonstrates knowledge of physical principles to optimize image quality.
    __Level 4: Independently modifies protocols as determined by clinical circumstances. Applies physical principles to optimize image quality.
    __Level 5: Teaches and/or writes imaging protocols.

    MK2: Interpretation of examinations
    __Level 1: Makes core observations, formulates differential diagnoses, and recognizes critical findings. Differentiates normal from abnormal.
    __Level 2: Makes secondary observations, narrows the differential diagnosis, and describes management options.
    __Level 3: Provides accurate, focused, and efficient interpretations. Prioritizes differential diagnoses and recommends management.
    __Level 4: Makes subtle observations. Suggests a single diagnosis when appropriate. Integrates current research and literature with guidelines to recommend management.
    __Level 5: Demonstrates expertise and efficiency at a level expected of a subspecialist. Advances the art and science of image interpretation.

    Professionalism – Milestones

    PROF1: Professional Values and Ethics
    __Level 1: Demonstrates professional behavior.
    __Level 2: Is an effective health care team member.
    __Level 3: Is an effective heath care team leader.
    __Level 4: Serves as a role model for professional behavior.
    __Level 5: Participates in local and national organizations to advance professionalism in radiology. Mentors others regarding professionalism and ethics.

    Interpersonal and Communications Skills – Milestones

    ICS1: Effective communication with patients, families and caregivers.
    __Level 1: Communicates information in routine, uncomplicated circumstances. Obtains informed consent.
    __Level 2: Communicates under direct supervision, in challenging circumstances, difficult information.
    __Level 3: Communicates under indirect supervision, in challenging circumstances, difficult information.
    __Level 4: Independently communicates complex and difficult information, such as errors, complications, adverse events, and bad news.
    __Level 5: Serves as a role model for effective and compassionate communication. Develops patient-centered educational materials.

    ICS2: Effective communication with members of the health care team: Written/Electronic
    __Level 1: Generates accurate reports with appropriate elements required for coding.
    __Level 2: Efficiently generates clear and concise reports that do not require substantive faculty member correction on routine cases.
    __Level 3: Efficiently generates clear and concise reports that do not require substantive faculty member correction on complex cases.
    __Level 4: Efficiently generates clear and concise reports that do not require substantive faculty member correction on all cases.
    __Level 5: Generates tailored reports meeting needs of referring physician. Develops templates and report formats.

    ICS2: Effective communication with members of the health care team: Verbal
    __Level 1: Communicates urgent and unexpected findings according to institutional policy and ACR guidelines.
    __Level 2: Communicates findings and recommendations clearly and concisely.
    __Level 3: Communicates appropriately under stressful situations.
    __Level 4: Communicates effectively and professionally in all circumstances.
    __Level 5: Leads interdisciplinary conferences. Serves as a role model for effective communication.

    Practice-Based Learning and Improvement – Milestones

    PBLI1: Radiation Safety
    __Level 1: Describes the mechanisms of radiation injury and the ALARA concept.
    __Level 2: Accesses resources to determine exam-specific average radiation dose information.
    __Level 3: Communicates the relative risk of exam-specific radiation exposure to patients and practitioners.
    __Level 4: Applies principles of Image Gently and Image Wisely.
    __Level 5: Promotes radiation safety.
  • AOCR Program Director Annual Resident Evaluation Report B. 360 Degree Evaluations
  • AOCR Program Complete Summary for Graduating Resident B. 360 Degree Evaluations
  • Monthly Formative Radiology Resident Evaluation of Faculty Enter description here.
    Rotation: ________________________

    Staff name: ______________________

    Instructions: Please evaluate the faculty member by checking a number from 1 to 5 with 1 representing "almost never" and 5 "almost always" regarding how often the faculty member performs each behavior. For parameters for which you have had no direct observation or those which do not apply to your interactions with the faculty, check "NA" (not applicable). Your evaluation will be kept anonymous and only compiled data will be presented to the faculty. Comments may be given at the end of the form.

    GENERAL:

    1. Staffs out studies early enough so that fellow/resident dictation can be completed by the end of the workday or the end of the scheduled call.

    Almost never 1 2 3 4 5 Almost always N/A

    2. Staff works efficiently without complaining about the amount of work to do and is considerate by attempting to avoid putting all the work on the fellow/resident.

    Almost never 1 2 3 4 5 Almost always N/A

    3. Staff regularly takes time out of work to teach fellow/resident how to recognize a diagnosis and associated imaging findings on an imaging study.

    Almost never 1 2 3 4 5 Almost always N/A

    4. Regularly attends scheduled conferences/lectures.

    Almost never 1 2 3 4 5 Almost always N/A

    5. At conferences, gives frequent high-quality teaching experience.
    Almost never 1 2 3 4 5 Almost always N/A

    6. Varies teaching methods (lectures, case presentations, slides, films, video, etc.).

    Almost never 1 2 3 4 5 Almost always N/A


    AVAILABILITY:

    1. Is available to help referring clinicians.
    Almost never 1 2 3 4 5 Almost always N/A


    Feedback:

    1. Gives the resident feedback during the rotation about how the resident is performing.
    Almost never 1 2 3 4 5 Almost always N/A


    Expertise/clinical skills:

    1. Maintains updated expertise by citing recent literature and new technology to resident (e.g. new radiological procedures, alternative imaging studies and methods).

    Almost never 1 2 3 4 5 Almost always N/A

    2. Integrates imaging findings and clinical history to narrow the differential diagnosis.
    Almost never 1 2 3 4 5 Almost always N/A


    Research:

    1. Helps fellow/resident design and overcome problems in pursuing the resident's own research project.
    Almost never 1 2 3 4 5 Almost always N/A
    2. Staff makes him-/herself available to assist residents in writing manuscripts for publication or in preparing oral presentations for local, national meetings or medical school lectures.

    Almost never 1 2 3 4 5 Almost always N/A


    Professionalism:

    1. Speaks well of other staff in front of colleagues or residents.
    Almost never 1 2 3 4 5 Almost always N/A

    2. Disagrees with a resident's interpretation without being insulting.

    Almost never 1 2 3 4 5 Almost always N/A
  • OSUMC Radiology Resident Annual Program Evaluation Enter description here.
    1. On average, how many hours do you spend per week in assigned duties? _______/week
    2. Do you average at least one day off per week? Yes_____ No _____
    If not, which rotation(s) did this occur?
    3. Do you feel that the program director and faculty members are available to you for advice and counseling?
    Yes _____ No _____
    4. Do you feel you get enough advice and counseling? Yes _____ No _____
    5. Does the Staff radiologist at the beginning of each rotation review the written learning objectives and expectations with you?
    Yes _____ No _____
    If not, on which rotation(s) did this not occur?
    4. Are you provided with written and verbal feedback at the end of each rotation? Yes _____ No ___
    If not, on which rotation(s) would you have liked to have had some feed back?
    5. Does the residency program place excessive reliance on service vs education? Yes _____ No _____
    If yes, on which rotation(s) did this occur?
    6. Is there a rapid and reliable system for you to communicate with your attending physicians?
    Yes _____ No _____
    If not, on which rotation(s) are there issues and what are the issues?
    7. Are you provided an adequate work area (computer/place to hang coat facilities)? Yes _____ No _____
    If not, at which facilities?
    8. Do you have any concerns regarding your safety while at OSUMC or CMH?
    Yes _____ No _____
    If yes, at which facilities?
    9. Are the library facilities adequate? Yes _____ No _____
    If not, please comment:
    10. Are you able to get enough procedures? Yes _____ No _____
    If not, please comment on why that may be or give your suggestions for improvement:
    11. My least favorite parts of the residency program are:
    12. My favorite parts of the residency program are:
    13. What would you suggest be done to improve the radiology residency program at OSUMC?
    14. Please make any other comments here:
  • AOCR Resident Evaluation of the Program
  • OSUMC Radiology Journal Club Worksheet H. Journal Club
    Resident name:
    Date of Journal club:
    Title & full citation of Journal article:
    Please comment on:
    • Abstract: (Ex - was it a concise overview? Did the conclusion match the aim? Were there discrepancies between the abstract and the body of the paper?)
    • Introduction: (Ex-did it include reasonable rationale why to do the study? Were goals of study included? Does it explain how the authors aims fit into what is already known on the subject?)
    • Materials and Methods: (Ex-Is this a good blueprint that another person could read and reproduce? Do the methods attempt to minimize bias and confounding factors? Are the patients included and excluded appropriately? Are correct statistics used?)
    • Results: (Ex- Do the results follow the order of the methods? Are there any unexpected results data sets? Are the results clear? Are all subjects and materials accounted for?)
    • Discussion: (Ex- Does it state if the hypothesis was verified? Does the discussion compare and contrast with prior literature? Is there an explanation of differences compared to prior literature? Are any unexpected results explained?
    • Conclusion: (Ex - Given the limitations of the study, are the conclusions valid? Does the conclusion respond to or answer the question asked in the aim of the study? Are the conclusions proven in the manuscript?)
    • What knowledge gap did this manuscript fill in (practice based learning improvement)?
    • Any other comments?

    Glossary:
    Evidence based medicine - Deciding which clinical practice to use based on critical literature analysis Practice based learning improvement - Filling in knowledge gaps.
    Reference: BudovekJJ. Evidence Based Radiology: A primer for reading scientific articles. AJR 2010;195:1-4
  • Resident Portfolio Form Enter description here.
  • Faculty Evaluation of the Residency Program Enter description here.
    Please use this scale to answer questions 1-10:

    1- Strongly Disagree; 2- Disagree; 3- Neutral; 4- Agree; 5- Strongly Agree


    ____1.  PATIENT/CASE VOLUME: There are a sufficient number and variety of patients/cases to facilitate high quality resident/fellow education.

    ____2.  CURRICULUM: The residency/fellowship program curriculum provides the appropriate educational experiences for residents/fellows to analyze, investigate and improve patient care practices.

    ____3.  PROGRAM DIRECTOR: The program director effectively communicates with program faculty members to understand their role in resident/fellow education and development.

    ____4.  ADMINISTRATIVE SUPPORT: There are adequate administrative support services to facilitate faculty participation in resident/fellow education.

    ____5.  SUPERVISION: The program resident/fellow supervision policy has been clearly communicated to program faculty and is used by the program.

    ____6.  TRANSITION OF CARE: The program transition of care/hand-off policy and tools have been distributed to program faculty and they are used.

    ____7.  EVALUATION: Program faculty receive regular and timely feedback about their teaching and supervision skills.

    ____8.  FACULTY DEVELOPMENT: There are beneficial resources available for program faculty to improve their teaching and supervision skills.

    ____9.  SCHOLARLY ACTIVITY: Program faculty have the adequate resources to participate in scholarly activities.

    ____10. FACULTY: The program faculty provide the diversity of experience and expertise to accomplish the goals and objectives of the program.



    Please describe the strengths of the residency:


    Please describe the opportunities for improvement in the residency:
  • Dictation Evaluation Form Enter description here.
    Stacks Image 93431
  • Procedure Competency Form Enter description here.