feat(langchain): add computer use tool

[christian-bromann]

Adds a new computerUse tool for the OpenAI provider, enabling the computer-use-preview model to control computer interfaces through mouse clicks, keyboard input, scrolling, and more.

Usage

import { ChatOpenAI, tools } from "@langchain/openai";

const computer = tools.computerUse({
  displayWidth: 1024,
  displayHeight: 768,
  environment: "browser",
  execute: async (action) => {
    if (action.type === "click") {
      await page.mouse.click(action.x, action.y);
    }
    return captureScreenshot();
  },
});

const model = new ChatOpenAI({ model: "computer-use-preview" });
const response = await model.bindTools([computer]).invoke("Check the news");

[changeset-bot]

🦋 Changeset detected

Latest commit: 5bc2c23

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 5 packages

Name	Type
@langchain/openai	Minor
@langchain/classic	Patch
@langchain/community	Patch
@langchain/deepseek	Patch
@langchain/xai	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[hntrl]

how come these are needed?

[christian-bromann]

since this code is touching openai code, it runs the integration test which have been failing for me in CI