Open-source ChatBot on local machine, now a possibility
Thread poster: Philippe Locquet
Philippe Locquet
Philippe Locquet  Identity Verified
Portugal
Local time: 11:45
English to French
+ ...
Jul 20, 2023

It seems the open-source community is hard at work making more and more LLMs alternatives available and improving the quality. It’s not exactly new (some options have been around for a while now. But we are slowly going towards systems that a tech-savvy user will be able to handle (like it’s been the case for Opus-MT which is now user-friendly).

These systems are not user-friendly yet, but a power-user with a last gen high end graphic card (over 1000 USD minimum if new). will b
... See more
It seems the open-source community is hard at work making more and more LLMs alternatives available and improving the quality. It’s not exactly new (some options have been around for a while now. But we are slowly going towards systems that a tech-savvy user will be able to handle (like it’s been the case for Opus-MT which is now user-friendly).

These systems are not user-friendly yet, but a power-user with a last gen high end graphic card (over 1000 USD minimum if new). will be able to run this locally and feed it context. AFAIK these are not able to translate at the moment.

If you’re interested, there’s a very interesting video by Rob Mulla https://www.youtube.com/watch?v=Coj72EzmX20&t=0s
If you’re curious but don’t want to dive into a technical tutorial, I made a short about this, summing things up. https://youtube.com/shorts/udeJe3yevBY?feature=share
Collapse


Mr. Satan (X)
 
Mr. Satan (X)
Mr. Satan (X)
English to Indonesian
Interesting Jul 21, 2023

Thanks. As an open-source software advocate, this sure does interest me. Will watch them videos this weekend.

Also, FYI:
https://www.theregister.com/2023/07/19/meta_llama_2/


Philippe Locquet
 


There is no moderator assigned specifically to this forum.
To report site rules violations or get help, please contact site staff »


Open-source ChatBot on local machine, now a possibility







Anycount & Translation Office 3000
Translation Office 3000

Translation Office 3000 is an advanced accounting tool for freelance translators and small agencies. TO3000 easily and seamlessly integrates with the business life of professional freelance translators.

More info »
Protemos translation business management system
Create your account in minutes, and start working! 3-month trial for agencies, and free for freelancers!

The system lets you keep client/vendor database, with contacts and rates, manage projects and assign jobs to vendors, issue invoices, track payments, store and manage project files, generate business reports on turnover profit per client/manager etc.

More info »