公開 LoRA アダプター

Cloudflare は、ファインチューン済みの推論にすぐ使える公開 LoRA アダプターをいくつか提供しています。playground ↗ からすぐに試せます。

公開 LoRA の名前は cf-public-x です。このプレフィックスは Cloudflare 用に予約されています。

名前	説明	対応モデル
cf-public-magicoder ↗	複数言語でのコーディング作業	`@cf/mistral/mistral-7b-instruct-v0.1` `@hf/mistral/mistral-7b-instruct-v0.2`
cf-public-jigsaw-classification ↗	有害コメントの分類	`@cf/mistral/mistral-7b-instruct-v0.1` `@hf/mistral/mistral-7b-instruct-v0.2`
cf-public-cnn-summarization ↗	記事の要約	`@cf/mistral/mistral-7b-instruct-v0.1` `@hf/mistral/mistral-7b-instruct-v0.2`

API 呼び出しで、これらの公開 LoRA を一覧することもできます。

Required API token permissions

At least one of the following token permissions is required:

Workers AI Write
Workers AI Read

List Public Finetunesbash

curl "https://api.cloudflare.com/client/v4/accounts/$ACCOUNT_ID/ai/finetunes/public" \
	--request GET \
	--header "Authorization: Bearer $CLOUDFLARE_API_TOKEN"

公開 LoRA で推論を実行する

公開 LoRA で推論を実行するには、リクエストで LoRA 名を指定するだけです。

LoRA の学習に使ったプロンプトテンプレートの利用を推奨します。各アダプターのテンプレートは、上のリンク先の HuggingFace リポジトリで確認できます。

cURL

curl https://api.cloudflare.com/client/v4/accounts/{account_id}/ai/run/@cf/mistral/mistral-7b-instruct-v0.1 \
  --header 'Authorization: Bearer {cf_token}' \
  --data '{
    "messages": [
      {
        "role": "user",
        "content": "Write a python program to check if a number is even or odd."
      }
    ],
    "lora": "cf-public-magicoder"
  }'

JavaScript

const answer = await env.AI.run("@cf/mistral/mistral-7b-instruct-v0.1", {
	stream: true,
	raw: true,
	messages: [
		{
			role: "user",
			content:
				"Summarize the following: Some newspapers, TV channels and well-known companies publish false news stories to fool people on 1 April. One of the earliest examples of this was in 1957 when a programme on the BBC, the UKs national TV channel, broadcast a report on how spaghetti grew on trees. The film showed a family in Switzerland collecting spaghetti from trees and many people were fooled into believing it, as in the 1950s British people didn't eat much pasta and many didn't know how it was made! Most British people wouldnt fall for the spaghetti trick today, but in 2008 the BBC managed to fool their audience again with their Miracles of Evolution trailer, which appeared to show some special penguins that had regained the ability to fly. Two major UK newspapers, The Daily Telegraph and the Daily Mirror, published the important story on their front pages.",
		},
	],
	lora: "cf-public-cnn-summarization",
});