Comment on Do you think Google execs keep a secret un-enshittified version of their search engine and LLM?
fizzle@quokk.au 1 day ago
The short answer is yes, and most companies do.
I have a small consultancy with a few staff, and im passionate about self hosting.
Using FOSS projects I’ve configured a selection of private services, which includes search and Gen AI. If I can do this with no resources…
salacious_coaster@feddit.online 1 day ago
Never considered self-hosting search. How does your LLM compare to the public ones?
fizzle@quokk.au 1 day ago
Not completely self hosted. Searxng is just a front end for a bunch of other engines, so it fetches results from google et al. Its good but glitches a lot as the engines themselves try to block it.
Yacy is self hosted, it crawls the sites you tell it to.
The LLMs are great. You can self host the models or just link to the hugging face API. The models you can find there are tuned for specific purposes and are far superior for those purposes. You can also train “agents” on top of those models, like upload your policy and procedure manual and ask it to create additional procedures in that context.