OmniRoute / Anza haraka na uwekaji

Endesha OmniRoute mahali unapodhibiti.

Sakinisha kifurushi, anzisha API ya ndani na uchague njia ya uwekaji inayotumika.

Anza haraka

Sakinisha, endesha na unganisha.

Sakinisha kifurushi, anzisha gateway, kisha elekeza mteja yeyote anayeoana na OpenAI kwenye port 20128.

Step 1: Sakinisha

Sakinisha kifurushi cha npm cha omniroute kwa mfumo mzima.

omniroute: install
$ npm install -g omnirouteadded 1 package

Step 2: Endesha

Anzisha API na dashibodi pamoja kwenye port 20128.

omniroute: run
$ omniroute▸ dashboard ✓ http://localhost:20128/dashboard▸ api ...... ✓ serving on :20128

Step 3: Unganisha zana yako

Tumia http://localhost:20128/v1; njia ya auto isiyohitaji key hufanya kazi kwenye usakinishaji mpya.

omniroute: connect
$ curl localhost:20128/v1/models✓ models listed

OmniRoute kutoka Cheaper Inference

Chagua jinsi unavyoendesha OmniRoute.

Jihudumie OmniRoute, au tumia Cheaper Inference kwa gateway inayohudumiwa na kupangwa kwa gharama.