ABOUT THE LECTICAL REFLECTIVE JUDGMENT ASSESSMENT*

The LRJA is an assessment of the way people think about knowledge, truth, and inquiry. It is based on an idea elaborated by John Dewey and investigated by Perry and Kitchener & King.

General information

For adolescents (12+) and adults

The LRJA presents an "ill-structured" dilemma—one that involves a big, thorny problem with no clear soution—then asks the test-taker (through a series of standard probes) to discuss the nature of the problem, important considerations, and how to go about gathering information, analyzing it, and making a decision. They are then asked to discuss their thinking about the nature of knowledge and truth.

There are several existing (and tested) LRJA dilemmas, which makes it possible to provide a new dilemma each time an individual takes the assessment. This feature is especially useful if you wish to test the effectiveness of a course or training intervention. Moreover, we can customize dilemmas for particular groups. For example, we have developed special versions of the LRJA for use in legal, medical, and educational contexts.

The LRJA is supplemented with a set of survey-like questions. These are designed to examine personal preferences, which helps us to produce more useful reports.

The LDMA must be completed in a single sitting. Please ask clients to set aside an hour to complete the assessment. They should also carefully read the assessment instructions before they begin writing to ensure that they receive their best score and don't accidentally lose their work due to a lost internet connection.

Dilemmas

Individuals who take the LRJA are asked to choose from this list of dilemmas (minus any they have already used). Click on the tabs in the list below to explore available dilemmas. You can specify which dilemma you would like your client, student, or research partcipant to take by providing the student with it's name and instructing him or her to select that name when choosing a dilemma.

{@name}

{lrjadilemma}

Check it out

You can examine the LRJA by logging on to the DTS site and choosing select an assessment, under the "take an assessment" item in the main menu on the left. You will need to enter information into the starred fields before you will be allowed to move from one page of the assessment to the next. Feel free to cut and paste blocks of random text into the essay fields.

Reliability and validity

The LRJA, like all Lectical Assessments, reliably distinguishes 8–10 adult developmental phases, where each phase represents 1/4 of a developmental level. All Lectical Assessments have very similar levels of reliability, because they are scored with the same developmental assessment system, the LAS.

Lectical assessments address two broad forms of validity: construct validity and ecological validity. First, like all Lectical Assessments, the LRJA is scored with the LAS, which is (1) based on a strong theory of development called Dynamic Skill Theory, and (2) has been submitted to a number of rigorous tests of its ability to capture the developmental construct described in that theory. These tests have shown that the LAS does a very good job capturing this dimension. To view the evidence, see the refereed papers under the articles tab on the articles page and articles by our colleagues on the reflective judgment references page.

Second, the ecological validity of the LRJA is apparent in the relevance of (1) its content—it features real-world dilemmas that stretch the best minds; (2) the skills required to complete it—skills for inquiry, information gathering, critical analysis of information, perspective-taking, argumentation, written communication, and decision-making; and (3) the scores and feedback provided in its reports.

To learn more about reliability and validity, see Dr. Dawson's blog.

Reports

Lectical assessments are distinguished by the accuracy of LAS scores and the quality of our feedback. Before we launch a Lectical Assessment, we carefully review the relevant research literature, then study how the skills and concepts targeted by the assessment develop over time, using a research methodology called developmental maieutics. The approach allows us to describe what targeted skills and concepts "look like" in each developmental phase, and to craft feedback and learning suggestions that are specific to each phase of performance.

In addition to general feedback related to the phase of a given performance, each LRJA report includes personal feedback, including comments on strengths and areas for growth, quality of argumentation, information gathering, critical analysis, perspective-taking, and recommendations for learning and development.

Reports are generally delivered within 5–7 business days. We send an email notification each time an assessment is finalized.

View sample reports.

Resellers

If you are interested in using the LDMA in your business or practice, please contact us for more information.