Pipeshift

Pipeshift is a fine-tuning and inference platform for open-source LLMs

• You bring your datasets. Fine-tune multiple LLMs. Start inferencing in one-click and watch them scale to millions.

Installation and Setup

• Install the Pipeshift integration package.

  pip install langchain-pipeshift

• Get your Pipeshift API key by signing up at Pipeshift.

Authentication

You can perform authentication using your Pipeshift API key in any of the following ways:

1. Adding API key to the environment variable as PIPESHIFT_API_KEY.

   os.environ["PIPESHIFT_API_KEY"] = "<your_api_key>"

2. By passing api_key to the pipeshift LLM module or chat module

   llm = Pipeshift(api_key="<your_api_key>", model="meta-llama/Meta-Llama-3.1-8B-Instruct", max_tokens=512)
   
                       OR
   
   chat = ChatPipeshift(api_key="<your_api_key>", model="meta-llama/Meta-Llama-3.1-8B-Instruct", max_tokens=512)

Chat models

See an example.

from langchain_pipeshift import ChatPipeshift

LLMs

See an example.

from langchain_pipeshift import Pipeshift