Introducing the AI Model 'Harness'

Dow Jones
Yesterday

Good morning. As AI continues to evolve rapidly, there's an increasingly important concept for business tech leaders to think about, and it's called the AI model harness.

The harness around a model is the code that actually runs the AI system, and it does things like provide memory and business data context for the AI model, and lets AI agents take actions, according to David Pan, a director and AI industry practice lead at Moody's.

In other words, the software harness around an AI model is simply a system wrapped around the brains, which are the AI models, Pan recently told me. A harness allows users to control and direct models, much like a harness allows a rider to guide a horse.

The idea of the model harness started becoming more prominent this year, developing alongside reasoning models. The fusion of a reasoning model with a capable harness allows the model to connect to real systems, execute code and manage workflows, according to Anthropic.

Why businesses need a model harness

But what makes the harness so important for enterprises? It's a way for companies to take back control of their AI, Pan says.

Developing their own software around AI models-a practice he calls "harness engineering"-gives businesses a way to decouple their workflows from the models themselves. And that helps them become less reliant on a single AI provider.

"If you bring that harness in-house and control it, you're baking in a lot more business resilience," Pan said.

While labs like OpenAI and Anthropic do offer their own model harnesses for enterprise customers, Pan argues that businesses in regulated sectors like banking and government should build their own to keep their workflows private.

But there are benefits to using a vendor-built harness, too. The biopharmaceutical giant Bristol-Myers Squibb chose Anthropic's Claude as its "standard harness" to avoid rebuilding basic infrastructure tooling, according to Greg Meyers, its chief digital and technology officer.

Another critical component of a model harness is a router-a piece of software that can automatically choose between frontier and cheaper models for various tasks. And that's an increasingly important tool businesses are relying on to keep their AI token costs down.

Moody's, the credit-ratings and research company that has been around for over a century, built its own model harness-like tool called the Research Assistant. The assistant, which is an AI agent chatbot, is able to use different Moody's data sets and can switch between AI models on the back end, Pan said.

More fundamentally, as tools and techniques around AI models continue to develop, the basic need to provide models with business data will always exist, Pan says. Whether the practice is called context engineering, prompt engineering or harness engineering, "what doesn't change is the ability to supply language models with the right context," he said.

Have you built your own AI model harness? Or are you using one built by a vendor? Send your feedback to me at belle.lin@wsj.com (if you're reading this in your inbox, you can just hit reply).

Founders Are Working Harder Than Ever to Keep Up With Their AI Agents

Founders have long put in punishing hours in the name of building the next big thing. But the growing capabilities of AI agents-and the speed at which the models powering them are evolving-give new meaning to working yourself to the bone, The Wall Street Journal reports.

The more work AI agents do, the more founders find themselves working. Add to that the pressure of what many view as a once-in-humanity moment in technology and you get erratic sleep schedules, a struggle to focus on anything but work, and the feeling that even though the pace isn't healthy or sustainable, you just can't stop.

On Our Radar

Chip makers are fighting to assure investors that the AI boom is racing forward. Wall Street might not believe it until Nvidia's Jensen Huang says so, The Wall Street Journal reports. When Huang steps up to the mic for his company's earnings call Wednesday, he will have the world's attention. What he says about Nvidia's present will preview the future of AI, dictate the path forward for a tech-crazed stock market and influence an American economy increasingly tethered to hopes that the boom won't go bust.

Toaster-shaped taxis that don't have a driver or a steering wheel have started rolling across San Francisco and charging for rides in Las Vegas. Amazon is betting it can become a major player in the growing robotaxi market, which Goldman Sachs expects to grow to nearly $19 billion in sales by 2030, from $376 million last year, WSJ reports.

Blackstone and Hellman & Friedman have formed a roughly 160-person team of AI experts with Anthropic to deploy at businesses, starting with their own portfolio companies. The push is part of a $1.5 billion joint venture between the AI giant and Wall Street firms, which also includes Apollo, General Atlantic and Goldman Sachs among the backers, WSJ reports.

Alibaba is aiming to raise $10.2 billion to invest in its AI build-out, looking to sharpen its edge as competition heats up. The Chinese tech heavyweight said Sunday that it entered into a placement agreement for 710 million new shares that will be offered to investors outside the U.S. at 112.70 Hong Kong dollars each, WSJ reports.

The WSJ Technology Council Summit

The WSJ Tech Council brings together CIOs, CTOs and CISOs advancing innovation and shaping the future. Join this trusted community where tech executives connect with peers to explore emerging trends and gain the perspective they need to stay ahead of disruption.

Request an Invitation

About Us

Follow Isabelle Bousquette on LinkedIn, Instagram, X, and TikTok for more behind the scenes on her tech and AI coverage, and lately, her contributions to the WSJ Leadership Institute's new Executive Resilience series, where she's profiling America's top execs about their fitness and wellness habits.

Follow Belle Lin on LinkedIn and X for her latest reporting on enterprise technology and AI.

Steven Rosenbush is chief of the enterprise technology bureau at the WSJ Leadership Institute. He also has a column. You can follow him on LinkedIn.

Tom Loftus is the editor of The Morning Download. He suggests following Isabelle, Belle and Steve on their various social channels. But if you insist, here's his LinkedIn.

 

At the request of the copyright holder, you need to log in to view this content

Disclaimer: Investing carries risk. This is not financial advice. The above content should not be regarded as an offer, recommendation, or solicitation on acquiring or disposing of any financial products, any associated discussions, comments, or posts by author or other users should not be considered as such either. It is solely for general information purpose only, which does not consider your own investment objectives, financial situations or needs. TTM assumes no responsibility or warranty for the accuracy and completeness of the information, investors should do their own research and may seek professional advice before investing.

Most Discussed

  1. 1
     
     
     
     
  2. 2
     
     
     
     
  3. 3
     
     
     
     
  4. 4
     
     
     
     
  5. 5
     
     
     
     
  6. 6
     
     
     
     
  7. 7
     
     
     
     
  8. 8
     
     
     
     
  9. 9
     
     
     
     
  10. 10