
audio_detach MCP tool: idempotency_key, jobs_wait, jobs_result
Hosted MCP exposes audio_detach. It needs an idempotency_key, mcp:write under OAuth, then jobs_wait and jobs_result to read the new audio_url.
The Sume video agent from code: Agent Completions, scheduled runs, MCP tools and timeouts, programmatic tool calling, and guardrails for paid APIs.
Start with: What is a video agent? How Sume defines and runs one

Hosted MCP exposes audio_detach. It needs an idempotency_key, mcp:write under OAuth, then jobs_wait and jobs_result to read the new audio_url.

Not with Sora, which OpenAI discontinued. ChatGPT can send a photo's public URL to an image-to-video tool over MCP and get a clip back.

Yes, through a video tool whose model generates audio. A voice that speaks your script is a second step: text to speech, then lip sync.

Not in one clip: generated clips top out at 15 or 30 seconds. ChatGPT can join many clips over one audio track into a render of up to 30 minutes.

With an upscaling tool, yes: ChatGPT can send a clip's public URL to a video upscaler over MCP. For new clips, ask for a higher resolution.

Yes, through tools: ChatGPT can make the slides, voice the script, and have a timeline tool hold each still for its line in one MP4.

ChatGPT can write the hook and, with a video tool over MCP, have a 9:16 clip rendered. Posting it to TikTok is a separate step you do.

With tools, yes: ChatGPT can have a track generated, a short clip made per section, and the clips cut over the song in one MP4 render.

To get a song or a beat as an audio file, give ChatGPT a music tool: in developer mode it can call one over MCP and hand back a link to the track.

Yes, with a video tool: in developer mode ChatGPT can send your product photo to a video model as the first frame and return a link to the clip.

Not by itself. With a video tool connected in developer mode, ChatGPT can script, voice, and lip-sync a UGC-style clip, confirming paid calls first.

ChatGPT writes the script; tools turn it into video. Voice it word for word, make one visual per line, and cut each to its sentence on a timeline.

Not for free. Free ChatGPT accounts can't turn on developer mode, and the video tool it calls needs its own paid plan and bills each clip.

Claude outputs text on every plan. Free can add one video tool as a connector, but the tool bills each clip, so the videos themselves aren't free.

Not by itself: Cowork's models output text. Add a remote MCP video tool as a custom connector and a Cowork task can render clips and images as links.

Claude can't generate images, transparent or not. Through an image tool it takes two calls: generate on a plain backdrop, then cut out a PNG with alpha.

Claude can't draw, but through an image tool one call can ask for several images, up to 4 per model today, and Claude can send one call per scene at once.

Claude can't make images itself. Through an image tool it can ask for a 4K tier on models that list one, then upscale a still up to 4x.

Claude can't create images, but it can send your product photo to an image tool as a reference and describe the new scene. How it works and its limits.

Claude writes the ad's concept and script but outputs text. With video, voice, music and editing tools connected, it can render and assemble the ad.

ChatGPT can write a podcast script. For a finished episode, give it speech tools over MCP: it voices each host's lines and joins them into one file.

Yes, with a connected tool: in developer mode ChatGPT can voice your script and lip sync a photo of you to it over MCP, then link the finished clip.

Give Claude Opus 5.5 a paid video tool without a surprise bill: dry_run previews cost, max_spend_usd caps a call, idempotency_key stops double submits.

Anthropic says Claude Sonnet 5.5 batches tool calls more than Sonnet 5. On Sume MCP, submit several clips in parallel, then wait on all with one jobs_wait.

Three ways to give an agent video generation on Sume: the hosted MCP server, the /v1/videos REST API as your own tool, or Agent Completions for the whole task.

OpenAI's GPT-6 guide describes async tool calling with async: true and call_id. How that maps to a video job that takes minutes, and where Sume's job ids fit.

OpenAI says ChatGPT Images 2.5 is available to Codex users. To call GPT Image 2.5 from your own code or agent, Sume offers hosted MCP and a REST API.

Claude Code loads MCP tools on demand with tool search, which is on by default. What that means for Sume's long hosted tool list and how to prompt for it.

Runway MCP agents can now reference Brand Kits, edited only in Runway's app. Sume's docs list no saved kit; you pass references per request.

Yes. Video agent APIs that turn a brief into a finished, edited video, compared by input, output, price unit, limits and revisions, and where Sume fits.

A video brief states the deliverable, audience, one message, must-show items, tone, and what done means. A template, and how an AI agent reads it.

PDF to video AI turns a document's text and figures into a narrated video. On Sume today, you extract the text and export the figures as images first.

Agentic video editing means an AI agent plans an edit, runs it with editing tools, and checks the result. What those tools are and what they can read.

HeyGen's Video Agent turns a text prompt into a finished avatar video, in the app or via POST /v3/video-agents. Its inputs, outputs, and API price.

A video shot list is one row per shot: number, what we see, framing, move, length, audio, source. A template to copy, plus the columns AI video needs.

No: Codex's docs list image generation but not video. Add a video tool over MCP, such as Sume's hosted server, and Codex can start clips for you.

Cursor's Agent has a built-in image generation tool but no video tool. To make video from Cursor, connect an MCP server that has one.

Five hosted MCP servers generate images: fal, Higgsfield, Replicate, Runway, and Sume. Their URLs, sign-in, models, and billing, from each vendor's page.

No. MCP is an open standard, so ChatGPT, Codex, Cursor, VS Code, and Gemini CLI can use the same server. What differs is each client's config and sign-in.

A workflow runs steps fixed in advance; an AI agent decides its own steps. When each fits, what an agentic workflow is, and how Sume offers both.

Not by itself: Claude outputs text. With a video tool it can make Shorts clips and long-form cuts, and Claude Code can script the YouTube upload.

An MCP server is a program that gives AI apps tools, data, and prompt templates through the Model Context Protocol. How it works, with examples.

A remote MCP server URL is the HTTPS address of a server's MCP endpoint. Where to get one, where to paste it, and why it isn't a page to open.

Function calling lets a model ask your app to run a function you defined; MCP puts tools on a server any client can discover. How they fit together.

A REST API is endpoints your code calls; MCP lets an AI app discover and call a server's tools at runtime. How they differ, and when to use each.

Sume's hosted MCP server has a paid generate_image tool: a prompt in, a job id back in milliseconds, then jobs_wait and jobs_result for the images.

ChatGPT Voice speaks its replies. To get your own script as an audio file, add a text-to-speech tool to ChatGPT over MCP in developer mode.

OpenAI discontinued Sora in 2026. ChatGPT can still start a video by calling a video tool on a remote MCP server in developer mode.

Claude's output is text, not video. It can still get you a clip by calling a video tool, such as Sume's hosted MCP server added as a connector.

No: Anthropic says Claude understands images but cannot create or edit them. Connect an image tool over MCP, such as Sume's generate_image.

Claude takes text and images, not video, and replies in text. It can still cut, crop, or assemble a clip by calling editing tools over MCP.

Sume's hosted MCP server has a paid generate_video tool: a prompt or image in, a job id back, then jobs_wait and jobs_result for the clip.

An agent skill is know-how the agent reads when a task matches; an MCP tool is an action it calls on a server. How they differ, and when to use both.

Human in the loop means an AI agent stops for a person before steps that matter. How Sume's agent does it in chat, and what replaces it in API runs.

Anthropic's pre-built skills cover documents, not video. A Sume CLI skill lets Claude Code make avatar videos; other clips need MCP or the API.

Sume's hosted MCP server gives agents three image edits: prompt edits from reference images, background removal to a PNG with alpha, and upscales.

MCP prompt injection gets an agent to call tools nobody asked for. Bound the session instead: fewer tools, read-only by default, confirmed writes.

An MCP server exposes tools; an agent is the program where a model decides which tools to call. How the work splits, with Sume's server and agent.

A YouTube chapter generator turns a transcript into timestamps and titles from 00:00: sentence timings from speech-to-text, topic breaks from an LLM.

To transcribe audio to text with Claude, give it a speech-to-text tool over MCP and a public audio URL, then read the transcript and word timings.

For text to speech in Claude, connect a text-to-speech tool over MCP: Claude sends the script and a voice, then hands back a link to the audio file.

Claude's models output text. Connect Sume's hosted MCP server with Write on, and Claude can script, voice, and lip-sync a UGC-style avatar clip.

Send an image to an agent API that can see it and ask for alt text, a title, or a product description as JSON fields. How to run it with Sume.

To make a video ad with AI, brief a video agent on the deliverable, review a draft before the paid render, then save the recipe to reuse it.

Connect Claude Code to Sume's hosted MCP with Write access, preview the cost with dry_run, then generate site images and save them in your repo.

Summarize a Sume-hosted video: pull stills and a transcript with POST /v1/video-inspect, then send both to Agent Completions with an output_schema.

Sume is a video agent platform: brief an agent in chat, save the recipe as a Format, and call it from your backend over one API. Surfaces and billing.

Sume Format runs, Scheduled runs, and Agent Completions share field names, not rules: spend-cap defaults, null, on_active_run, attachments, and scopes differ.

Sume's on_active_run field decides what a second run request does while one is in flight: run anyway, record a skipped run, or get a 409 and nothing runs.

On Sume, HTTP and the Format API are the primary path for AI agents. Hosted MCP fits remote MCP clients; the CLI fits shell agents and is Avatar-heavy.

On Sume's hosted MCP server, one jobs_wait call holds at most 55 seconds. Wait out long video jobs in slices, batch up to 20 ids, and never resubmit.

The Sume MCP tools list by family: which hosted tools only read, which write, which start paid jobs, and which tool names are not on hosted MCP at all.

script_run is programmatic tool calling on Sume's hosted MCP: a short JavaScript program calls tools in loops or in parallel under call and paid budgets.

Sume's hosted MCP server gives AI agents video editing tools: inspect, frames, trim, filter, audio detach, compose, and a Timeline render, each run as a job.

List Sume schedules with GET /v1/actions (limit, status, trigger_type), page each run history with a cursor, and read trigger.source to tell cron from API runs.

Send images to Sume Agent Completions as input_image parts or attachments, bind an output_schema, and read typed JSON from output when the run completes.

In Sume's docs, a video agent is a sandbox Agent that composes generation tools into a post-ready video. Brief it in chat, or call it over HTTP.

Keep agents read-only by default, keep secrets out of logs, and on hosted MCP send an idempotency_key, preview with dry_run, and cap with max_spend_usd.

A Sume schedule is a saved Agents automation that runs on a cron cadence and returns a run receipt. Author it in the dashboard; start and monitor runs by API.

POST /v1/agent/completions runs the same agent as the Sume Agents chat, with tools and media generation, and returns an async run receipt you poll or webhook.