-
Notifications
You must be signed in to change notification settings - Fork 53
Updates Weave's landing page with new auto-instrumentation skill #2985
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -73,21 +73,27 @@ Select your workload type and then use the following docs to guide you through t | |
| </Tab> | ||
| </Tabs> | ||
|
|
||
| ## Install Weave | ||
| ## Automatically instrument Weave | ||
|
|
||
| W&B Weave provides Python and TypeScript libraries. To install the Weave library, run the following command: | ||
| To automatically instrument your agents to use Weave, update the following prompt with your project name and [W&B API key](https://wandb.ai/settings) environment variables, then pass the prompt to your agent: | ||
|
|
||
| <Tabs> | ||
| <Tab title="Python"> | ||
| ```bash | ||
| pip install weave | ||
| ``` | ||
| </Tab> | ||
| <Tab title="TypeScript"> | ||
| ```bash | ||
| npm install weave | ||
| ``` | ||
| </Tab> | ||
| </Tabs> | ||
| ```text | ||
| Fetch and then use the following skill to instrument all agents with Weave: | ||
|
|
||
| https://raw.githubusercontent.com/wandb/weave/refs/heads/master/skills/weave-instrument/SKILL.md | ||
|
|
||
| Project configuration: | ||
| WEAVE_PROJECT=$[YOUR-PROJECT-NAME] | ||
| WEAVE_API_KEY=$[WANDB-API-KEY]`; | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I wouldn't think it'd be a good idea to pass an API key visibly through a prompt to an LLM?
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I think that's what the
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. oh, i thought that was setting an environment variable to the value, and that we were asking them to replace [WANDB-API-KEY] (since that's our replaceable format style) with the text of the key? would we want the brackets on there if it is supposed to be reading from an en var that exists by that name? also, confused why we're setting WEAVE_API_KEY? i checked the SKILL and it doesn't have this token
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. like, the skill has an auth-related section, but says nothing about WEAVE_API_KEY:
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. i interpret that as these are the instructions we'd give the user up top:: "authenticate in your own
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. WEAVE_PROJECT doesn't seem to be used by the skill either? (tho sounds like the skill will prompt for it itself) |
||
| ``` | ||
|
|
||
| Your agent installs Weave's auto-instrumentation skill and uses it to: | ||
|
|
||
| 1. Install the Weave package, authenticate with W&B, and add `weave.init("YOUR-TEAM-NAME/WEAVE_PROJECT")` to agent entry points. | ||
| 1. Identify the codebase's language, LLM/agent libraries, agent's structure (loop, model calls, tool dispatch, sub-agents), and any existing OTel setup. | ||
| 1. Help you structure your trace data and properly instrument your application. | ||
| 1. Verify the configuration works by sending traces to your Weave project. | ||
|
|
||
| Once you've completed the configuration, your agents automatically start sending traces to Weave. | ||
|
|
||
| To start using the Weave library, create a [Weights & Biases (W&B) account](https://wandb.ai) and an [API key at User Settings](https://wandb.ai/settings). The API key allows you to authenticate to your W&B account and start sending data to it. | ||
| If you want to manually instrument an agent, see [Quickstart: Set up custom agent observability](/weave/custom-agents-quickstart). | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
also, curious why we're providing this 'raw' link instead of the actual repo https://github.com/wandb/weave/blob/master/skills/weave-instrument/SKILL.md?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think the idea is to make it as easy as possible for the agent to ingest. This is Andrew's prompt that he designed and put in the Weave UI, so I was just copying the workflow he designed.