Every managing partner in New York is getting pitched on AI training right now. The emails all sound the same: “transform your practice,” “stay ahead of the curve,” “AI-powered efficiency.” Most of them are selling generic webinars repackaged as custom training.
Here’s how to tell the difference between a vendor that will actually move your firm forward and one that will waste your budget and your attorneys’ time.
Start with What Your Firm Actually Needs
Before you talk to a single vendor, answer three questions:
- What tools are your attorneys already using (or about to use)? If you’re rolling out CoCounsel, Harvey, or even just advanced features in Westlaw Edge, training should map directly to those tools — not to “AI in general.”
- What does your malpractice carrier require? Several NY carriers now ask about AI usage policies. Your training vendor should know this landscape and help you stay compliant, not just productive.
- Where are the actual pain points? Contract review? Discovery? Client intake? Good training solves specific workflow problems. Bad training teaches people what a large language model is.
If a vendor can’t tell you exactly which workflows they’ll improve and by how much, they’re selling awareness, not capability.
The Five Questions That Separate Real Vendors from Slide Decks
1. “Can you show me the curriculum — not just the topics?”
A serious vendor will show you detailed session plans, exercises, and deliverables. A weak vendor will show you a topic list that could apply to any industry.
Red flag: “We customize everything” but they can’t show you a sample module. Customization without a strong base curriculum usually means they’re building it as they go — on your dime.
2. “What happens after the training sessions end?”
Training that stops when the instructor leaves the room has a half-life of about two weeks. Look for:
- Written AI usage policies tailored to your firm’s practice areas and risk profile
- Reference materials attorneys can use at their desks — not just slide decks
- Follow-up check-ins to troubleshoot adoption issues
- Metrics that show whether attorneys are actually using what they learned
The goal isn’t “we trained 40 attorneys.” The goal is “40 attorneys changed how they work.”
3. “Who is delivering the training?”
This matters more than anything on the vendor’s website. Ask specifically:
- Does the trainer have a JD? Have they practiced?
- Do they understand NY ethics rules — not just “legal ethics” in the abstract?
- Can they speak to the specific tools your firm uses?
A former BigLaw associate who now does AI consulting is fundamentally different from a tech company sales engineer who read a few CLEs. Your attorneys will know the difference in five minutes.
4. “How do you handle the ethics and compliance piece?”
In New York, this is not optional. Between the NYSBA’s guidance on AI use, evolving case law on disclosure obligations, and individual judges’ standing orders, the compliance landscape is complex and changing fast.
Your vendor should be able to speak fluently about:
- Disclosure obligations when AI assists in legal work product
- Confidentiality risks — what data goes where when attorneys use AI tools
- Supervisory responsibilities under the Rules of Professional Conduct
- Documentation practices that protect the firm if something goes wrong
If the compliance section of their training is a 10-minute overview at the end, find someone else.
5. “What’s the pricing model, and what’s included?”
Watch for:
- Per-attorney pricing that scales unreasonably with firm size
- Tiered packages where the compliance and policy pieces are only in the expensive tier (these should be table stakes, not upsells)
- Annual contracts with no performance benchmarks
- Hidden costs for materials, follow-up sessions, or policy documents
A good vendor will price transparently and tie at least part of their value to measurable outcomes.
What Good Training Actually Looks Like
The best AI training programs share a few characteristics:
- Practice-area specific. Litigation attorneys and transactional attorneys use AI differently. Training should reflect that.
- Hands-on from day one. Attorneys learn by doing, not by watching demos. Every session should include exercises using real (anonymized) work product.
- Policy-first. The AI usage policy comes before the tool training, not after. Attorneys need to know the guardrails before they start experimenting.
- Ongoing, not one-shot. AI tools change fast. A single training event in March is outdated by June. Look for subscription or retainer models that include updates.
- Measurable. Before-and-after metrics on specific workflows. Time-to-completion on contract review. Accuracy rates on research tasks. If the vendor can’t measure it, they can’t prove it worked.
The Cost of Getting This Wrong
Bad AI training isn’t just a waste of money. It creates real risk:
- Attorneys who don’t trust AI tools because their first experience was confusing or irrelevant — and now they won’t adopt tools that could genuinely help
- Compliance gaps because the training skipped the ethics piece or covered it superficially
- Malpractice exposure from attorneys who learned to use AI tools without learning their limitations
- Wasted licenses on AI tools that sit unused because nobody was trained properly
For a 15-attorney firm, a bad training engagement can easily cost $15–25K in direct fees plus months of lost productivity. Getting it right the first time matters.
Quick Evaluation Checklist
Before signing with any AI training vendor, confirm:
- They can show you a detailed curriculum, not just a topic list
- Training includes NY-specific ethics and compliance content
- The trainer has legal practice experience (not just tech background)
- Post-training support is included (policy documents, follow-up sessions, reference materials)
- Pricing is transparent with no hidden costs for essential components
- They can point to measurable outcomes from previous engagements
- The program is tailored to your practice areas, not generic “AI for lawyers”
- There’s a subscription or update component — not just a one-time event
Bottom Line
The AI training market for law firms is growing fast, and most of what’s out there is mediocre. The vendors worth hiring are the ones who understand that training attorneys on AI is fundamentally a legal competence and ethics problem, not a technology problem.
Ask hard questions. Demand specifics. And don’t sign anything until you’ve seen the actual curriculum — not the pitch deck.
Fractal Legal helps New York law firms implement AI tools with proper training, compliance policies, and ongoing support. We combine legal domain expertise with hands-on AI training tailored to your practice areas. Book a 15-minute call to see if we’re the right fit.