Monday, November 1, 2010

Are MFT licensing exam prep courses a good value?

Several companies offer products and services to help marriage and family therapists prepare for MFT licensing exams. These offerings may cost hundreds of dollars. Are they worth your money?

Last week, I posted a few tips for preparing for MFT licensing exams, including a list of providers of study courses and materials. I purposefully sidestepped the question of whether such products are worth the cost, which easily can add up to several hundred dollars. It's hard to know for sure.

Over the years I have known quite a few folks, including staff at California's Board of Behavioral Sciences, who hold particular disdain for test prep companies, viewing them as profiteers who make money by fostering test anxiety. The companies can do this partly because it is very difficult to measure their true usefulness. When examinees use the exam prep companies and then pass the licensing tests, it is difficult to tell whether their success came from the company's help, or whether the examinee would have passed anyway using just their own study skills. Either way, of course, the test prep company is usually happy to take credit for the passing score.

There are at least a couple of reasonable arguments to be made against using these companies to prepare for your MFT license exams. But for each argument, there is a strong counter. Here are both sides. The final decision, of course, is up to you.

===

The anti-prep-company argument: If one's education was adequate and they received quality supervision after graduation, passing the exam should not require spending hundreds of dollars to re-educate oneself about how to do therapy in a way that is minimally competent.

The counter: It's an understandable argument, but ignores a couple of realities: One, quality education and supervision are pretty big "ifs." There are major differences between educational programs in how their MFT graduates perform on licensing exams, and while that is not all due to differences in the grad school experience, I suspect at least some part of it is. There are also bound to be supervisors who offer less-than-ideal supervision experiences, especially when the bar for becoming a supervisor is set low (in California, one needs only to have been licensed for two years and taken a six-hour supervision course to supervise interns and trainees). And two, whether they really need it or not, a lot of examinees say that they want the additional preparation. It solidifies their existing knowledge and helps them to go into the exams with more confidence. So, test preparation companies can provide a valuable, if expensive, service for those who feel they need or want it. Not everyone does.

===

The anti-prep-company argument: Licensing exam prep companies thrive off of perpetuating the myth that there is some top-secret test knowledge that the companies have that examinees cannot get elsewhere.

The counter: While it is true that the necessary knowledge can come from the very textbooks used in graduate programs (these are typically what subject matter experts use to craft the licensing exam items), it is also true that success in testing relies at least in part on good test-taking skills. And a good test prep company will offer guidance on both specific content and test-taking strategies.

===

So, are the test-prep companies right for you? There is no easy-to-determine answer. Even if we had enough data to say whether these prep programs work in general, that does not really answer the question of whether they would make a difference specifically for you. Still, the companies would do themselves and their customers a favor if they gathered and published the following data:

  • Average customer improvement. For workshops and training courses, brief pre- and post-tests could help current and potential customers see just how much people are picking up.
  • Retention rates. Give that post-test again two weeks after they are done with the course or workshop. If customers are not holding onto their gains, there's a problem.
  • Exam pass rates. This seems obvious, but many companies do not actually collect this data. They should. Just demonstrating that the pass rates for their customers are higher than average would be significant.
  • Reimbursement requests. Some companies guarantee that you will pass your exam or get your money back. How many people actually take them up on that? Even among those who do not pass, most can recognize the difference between weaknesses in their own study habits and weakness in the material they were provided.
As I said last week, use the strategies you have learned work best for you in helping prepare for licensing exams. If you do decide to work with a test-prep company, gather as much information you can before choosing which one to work with. That may mean asking them some uncomfortable questions. But if the test-prep company cannot calmly and accurately answer questions under pressure, how can you reasonably expect that they could prepare you to?

4 comments:

Anonymous said...

I am currently studying for my MFT exam. After years of interning I consider myself a solid therapist. The exam, however does not test my true knowledge base. The exam questions have nothing to do with how one practices. For this reason, I believe that some of the course do help in reviewing the materials that were never used after graduation.
The BBS should be more concerned about adjusting the exam to truly test a candidates everyday skills rather than some of the tricky questions they put on there just to test if the person is paying attention....

Anonymous said...

Can you please recommend a good prep organization for California MFT exam? I simply want one that has good results.

nrhine said...

I agree with Anonymous above. What is up with the trick questions? Are there trick questions?! It is seeming that way to me as I take the online practice tests. How are we supposed to deal with that? Learn some "secrets" somewhere? Grrr.

Ben Caldwell said...

I've spent enough time with BBS (California Exam) and AMFTRB (National Exam) folks that I can say this with confidence: They don't want trick questions on exams any more than you do. They actually work quite diligently to ensure that there are no "trick questions," and there should be no "secret knowledge" needed to pass the exams. Any exam question that assesses anything other than your ability to practice independently without endangering the public is not doing what they want to exams to do.
 
Along the same lines, I'd like to lay to rest the notion that a licensing exam is supposed to test your clinical skills. It isn't. A licensing exam exists so that a state board can know whether you are minimally competent to practice on your own without presenting a danger to the public. That's all. And for that reason, what the first commenter labeled "everyday skills" are probably less important than what the therapist would do in a crisis or reporting situation -- precisely the kinds of situations that represent potential risk to your clients but *don't* happen every day.
 
If you're a supremely skilled clinician, your clients will surely appreciate it and you will likely do well in the field. That's not what licensing exams test, which frustrates a lot of people. But it's not what licensing exams are supposed to test.