Install LibreChat Locally

I have been following this Liber chat

for quite some time and people say that

it is quite easy to install and

use I agree partially I think if you're

using it with open AI then yes it is

quite easy to install and use but if

you're trying to use it with open source

models such as AMA which it says it in

its documentation then to say the least

it is terrible it is very hard to

configure it is even if you manage to

configure it somehow it's very hard to

run so the good thing about Liber chat

is that it offers you a similar

interface just like jgpt but of course

if you're using it with open a a API key

then the point is only that you can

install it locally on your network and

then use it but still you would need to

configure a reverse proxy which you can

easily do with it but all in all I think

maybe 3 to 4 months back this was true

but now when we have so much uh so many

options out there I think the edge that

Liber chat had that it it was offering

the same interface as chat GPT is a

modood point now but anyway in this

video I'm going to show you how you can

get it installed locally I would suggest

you install this this Liber chat on

Linux because if you try to install it

on Windows they recommend you use Docker

and using uh Docker on Windows is

another pain because um well I'm not

going to go into that you can do that

but I would suggest you do it in Linux

especially if you are trying to install

it companywide anyway so let's um go to

my local system but before that let me

actually uh tell you few of the good

features about it because not everything

is bead about Liber uh chat Liber chat

as I said the main attraction is was

that it had um chat gbt like interface

and they say that you can integrated

with open AI API key coare

gini um together mrol API lot of other

API providers First thing second it is

multilingual you can go with English

French Italian Brazilian Portuguese and

there are few other languages which it

supports you can also customize the

presets you can save them you can import

the conversations but but as I said all

of these options they were great they

still are great but few months back when

no one else or very few companies were

offering it it was okay but now there

are many tools which are doing that and

you can even search my channel I have

covered a lot of

them so I believe liary chat needs to

pick up their game and uh you know if

they are saying they integrated with o

Lama which is awesome then they should

really make it easy if you go to their

documentation it's terribly written

anyway so let me go to my local system

and then we will get it

installed I am using ob2

22.041 GPU card of 22 GB of vram and my

memory is 32 GB I will be using K in

order to get it installed so let me

first clear the screen and this is the K

version which I am using if you don't

know how to install K and all that stuff

I would highly suggest that you just

search on my channel and install it

keeps everything separate

simple okay let's clear the screen yeah

where is a clear this is clear and now

let me create a virtual environment with

K I'm just calling it liary chat it says

that it's already exist so I'm just

going to say no and I am going to first

remove that environment so K remove

dasn Liber

chat and I will install

it from scratch that is done let's clear

the screen I'm also going to remove the

okay that's all clear let me try

again that is good and let's wait for it

to get installed that is done let's

activate the library chat and you will

see that now it appears

in parenthesis at the start of the prop

next thing we need to get clone the Appo

let me first clear the screen

let's click get uh clone the

Appo that

is done cool and let's C to Liber chat

let's clear the

screen now here uh you would need to use

the EnV file you would need to move it

so maybe I'll just say cp. ENB example

Tob so now we have this.b file if I

quickly show you this EnV file it just

mentioned that Port 380 Local Host

but it uses mongod DP at the back end in

the container and there are lot of other

stuff which you can use this is the

reverse proxy because if you're using

any such software in your Enterprise in

your private Network then in order to

talk to these API outside on the

internet you would need a reverse proxy

and that is where this proxy is quite

handy and this is what I like about

liary chat that um it offers this

reverse proxy out of the box cool okay

so and then there are lot of other if

you want to use anthropic like Cloud

Model you can use that and Bing

Microsoft Google like Gemini and stuff

because this Liber chat also offer

multimodel functionalities with Gemini

gp4 so if you want to use that okay let

me get out of this now in order to start

it all you need to do is to run Docker

compose up TD and it is going to

download all of it and start it because

you saw that I already had downloaded it

so it took bit of a time but it has

started all the containers which include

Vector DB for R mongod DB and Liber chat

and all of them are

up cool so now let me open it on Port

3080 in my local browser and I will show

you how it looks

like this is how it looks like first

time in your browser locally you would

need to sign up first time let me fill

in my name and my email password you can

create your own and then I'll click on

continue I have filled up my stuff so

I'm just going to click continue and

then I'm going to fill in my

email so I'm just going to continue

logging in and there you go so you see

you just get open a chat GPT like

interface you can click here you can

just also attach your file and talk with

it and you can select the models from

open a like gp4 turbo and all that stuff

you can also set your key so for example

if you click on your name here you can

go to settings and then you can uh set

up your theme by have go with uh this

dark one which is always good and then

you can change your picture and do lot

of other stuff

here also you can select gp4 turbo and

if you click on open AI you can go with

open a assistant and then it is asking

you to set your API key so click here

and then you can just uh enter your

value here and click on submit so let me

do

that I have submitted my open a API key

if you don't have it just go to

platform.

open.com and you would it's a paid

option so you would have to pay them at

least $10 to get your key so I already

have done it as you can see and then you

can chat with gp4 you can talk with as

much as you

like and it's a simple interface so I'm

just going to ask it explain the meaning

of happiness and dp4 is just giving me

all that

stuff so now um just imagine that you

want to use gp4 within your private

Network without any access to Internet

then liary CH liary chat makes sense

because you just need to set your

reverse proxy where I showed you in

thatv file you need to specify your API

key and your employes will be able to

use it and you see that you they would

have to create a login password and then

they can go from there and if you want

you can just attach your own files here

and then chat with your files and then

there are lot of other options which you

can use so look all in all a good tool

but as I said earlier um the real

benefit comes when we would be able to

easily integrate cre AMA with it for now

I have already spent like 3 4 hours on

it configuring AMA didn't work

so um they their documentation is very

poorly written so I'll keep trying if I

manage to in get it installed easily and

then if it would be worth showing I will

make another video but I think for now

you get the idea that when to use Li

chat and when do not to use it let me

know your thoughts in it and if you have

already configured AMA with libr chat

please share your experience in the

comments maybe I am too dumb to um

configure it easily so would be good

learning exercise if you like the

content please consider subscribing to

the channel and if you're already

subscribed then please share it among

your network as it helps a lot thanks

for watching