Monday, November 1, 2010

Are MFT licensing exam prep courses a good value?

Several companies offer products and services to help marriage and family therapists prepare for MFT licensing exams. These offerings may cost hundreds of dollars. Are they worth your money?

Last week, I posted a few tips for preparing for MFT licensing exams, including a list of providers of study courses and materials. I purposefully sidestepped the question of whether such products are worth the cost, which easily can add up to several hundred dollars. It's hard to know for sure.

Over the years I have known quite a few folks, including staff at California's Board of Behavioral Sciences, who hold particular disdain for test prep companies, viewing them as profiteers who make money by fostering test anxiety. The companies can do this partly because it is very difficult to measure their true usefulness. When examinees use the exam prep companies and then pass the licensing tests, it is difficult to tell whether their success came from the company's help, or whether the examinee would have passed anyway using just their own study skills. Either way, of course, the test prep company is usually happy to take credit for the passing score.

There are at least a couple of reasonable arguments to be made against using these companies to prepare for your MFT license exams. But for each argument, there is a strong counter. Here are both sides. The final decision, of course, is up to you.

===

The anti-prep-company argument: If one's education was adequate and they received quality supervision after graduation, passing the exam should not require spending hundreds of dollars to re-educate oneself about how to do therapy in a way that is minimally competent.

The counter: It's an understandable argument, but ignores a couple of realities: One, quality education and supervision are pretty big "ifs." There are major differences between educational programs in how their MFT graduates perform on licensing exams, and while that is not all due to differences in the grad school experience, I suspect at least some part of it is. There are also bound to be supervisors who offer less-than-ideal supervision experiences, especially when the bar for becoming a supervisor is set low (in California, one needs only to have been licensed for two years and taken a six-hour supervision course to supervise interns and trainees). And two, whether they really need it or not, a lot of examinees say that they want the additional preparation. It solidifies their existing knowledge and helps them to go into the exams with more confidence. So, test preparation companies can provide a valuable, if expensive, service for those who feel they need or want it. Not everyone does.

===

The anti-prep-company argument: Licensing exam prep companies thrive off of perpetuating the myth that there is some top-secret test knowledge that the companies have that examinees cannot get elsewhere.

The counter: While it is true that the necessary knowledge can come from the very textbooks used in graduate programs (these are typically what subject matter experts use to craft the licensing exam items), it is also true that success in testing relies at least in part on good test-taking skills. And a good test prep company will offer guidance on both specific content and test-taking strategies.

===

So, are the test-prep companies right for you? There is no easy-to-determine answer. Even if we had enough data to say whether these prep programs work in general, that does not really answer the question of whether they would make a difference specifically for you. Still, the companies would do themselves and their customers a favor if they gathered and published the following data:

  • Average customer improvement. For workshops and training courses, brief pre- and post-tests could help current and potential customers see just how much people are picking up.
  • Retention rates. Give that post-test again two weeks after they are done with the course or workshop. If customers are not holding onto their gains, there's a problem.
  • Exam pass rates. This seems obvious, but many companies do not actually collect this data. They should. Just demonstrating that the pass rates for their customers are higher than average would be significant.
  • Reimbursement requests. Some companies guarantee that you will pass your exam or get your money back. How many people actually take them up on that? Even among those who do not pass, most can recognize the difference between weaknesses in their own study habits and weakness in the material they were provided.
As I said last week, use the strategies you have learned work best for you in helping prepare for licensing exams. If you do decide to work with a test-prep company, gather as much information you can before choosing which one to work with. That may mean asking them some uncomfortable questions. But if the test-prep company cannot calmly and accurately answer questions under pressure, how can you reasonably expect that they could prepare you to?

7 comments:

Anonymous said...

I am currently studying for my MFT exam. After years of interning I consider myself a solid therapist. The exam, however does not test my true knowledge base. The exam questions have nothing to do with how one practices. For this reason, I believe that some of the course do help in reviewing the materials that were never used after graduation.
The BBS should be more concerned about adjusting the exam to truly test a candidates everyday skills rather than some of the tricky questions they put on there just to test if the person is paying attention....

Anonymous said...

Can you please recommend a good prep organization for California MFT exam? I simply want one that has good results.

nrhine said...

I agree with Anonymous above. What is up with the trick questions? Are there trick questions?! It is seeming that way to me as I take the online practice tests. How are we supposed to deal with that? Learn some "secrets" somewhere? Grrr.

Ben Caldwell said...

I've spent enough time with BBS (California Exam) and AMFTRB (National Exam) folks that I can say this with confidence: They don't want trick questions on exams any more than you do. They actually work quite diligently to ensure that there are no "trick questions," and there should be no "secret knowledge" needed to pass the exams. Any exam question that assesses anything other than your ability to practice independently without endangering the public is not doing what they want to exams to do.
 
Along the same lines, I'd like to lay to rest the notion that a licensing exam is supposed to test your clinical skills. It isn't. A licensing exam exists so that a state board can know whether you are minimally competent to practice on your own without presenting a danger to the public. That's all. And for that reason, what the first commenter labeled "everyday skills" are probably less important than what the therapist would do in a crisis or reporting situation -- precisely the kinds of situations that represent potential risk to your clients but *don't* happen every day.
 
If you're a supremely skilled clinician, your clients will surely appreciate it and you will likely do well in the field. That's not what licensing exams test, which frustrates a lot of people. But it's not what licensing exams are supposed to test.

Anonymous said...

I just passed the first exam. I used the GG materials. I found it to be way overkill. They have u Preparing for all kinds of things that are NOT on the actual exam, and most frustrating, the practice exams are very different from the real thing

GG has u practice for all kinds of trick questions and questions related to specific theoretical orientations. There were NO "trick" questions and no more than 10 questions asking about specific theories. I'm actually pretty disappointed to have spent all that time and money. I wish there were a formal comparison b/w GG success rates and other programs before I study for the second exam.

Anonymous said...

I did not pay for the GG course or practice test but found that the questions were trick questions on their practice test. It is reasuring to know that the GG test questions and practice exams are very different from the real thing. They are the only practice tests I have been doing poorly on, I am glad I chose not to pay for it.

Anonymous said...

I recently passed the CA MFT Standard Exam (the first exam) and utilized both AATBS and Gerry Grossman's materials to study for the exam. I found the study materials to be completely necessary and I will readily admit that I would not have passed without these test prep companies. Gerry Grossman, in particular, I found to be very helpful in preparing for the exam; AATBS less so but still worth utilizing.
It's not only helpful to refresh yourself with the information that will be on the test (especially if there was a significant gap in the time you got your degree and when you completed your hours or if your MFT program was lacking) but it is also helpful in understanding the thinking that the BBS has behind the test. The BBS isn't particularly interested if you are the best therapist around. Just as Ben stated, they are focused on ensuring that you are not a danger to the public and can practice with a basic level of competence and understanding of psychotherapeutic principles. The test is difficult but preparing for it was a good experience for me. I'm a much more competent and confident clinician as a result.
I agree that the actual exam did not have "trick questions" and that both AATS and Gerry Grossman's practice exams did contain "trick questions". I actually found those questions to be helpful in getting me to really read through each question and fully conceptualize what is being asked. I believe that is the purpose for those questions in the training materials and believe me, it trains you to read things carefully and apply the study strategies you have been taught.
I'm now preparing for the second test and finding the process to be much more difficult than the first test. When I finally receive my MFT license, I will certainly feel it is rightly deserved.