I guess to me be able to serve the 408b model even though I’m on a laptop is just awesome to me.
Also I saw Lora was an option for Petals but I haven’t messed with it at all.
Fuckyoupayme is more about setting a bar for what people can ask of you. If someone suggests something and you think “heck yeah I’d personally want that” its not really an issue.
The splitting is 80% of the cool factor for me. Rather than bog down the one node that can handle those cooler models, and have more contribution opportunities.
I wonder honestly if a petals network could be a target host on horde lol
I, a systems guy, have a better time learning go than nix packages.
The lang is just rough for me for some reason. I use it as glorified pigs.txt atm instead of my single source of truth for my system.
You have to put the highest scoville rated ingredient on your hot food stall.
I do not want to be surprised in either direction.
100% like can you message me? Sure. Will I help or hell respond? Probally not tbh. Work, chores, and hobbies keep me busy enough.
Right. I feel like maybe Free Desktop standard, tight integration with top toolkits (qt, gtk, etc) and a some image recognition for fall back.
Honestly maybe we need something like a portable guided tour format (you the “see what’s new in …” things but from strangers for specific thing).
I will say part of problem is knowledgeable volunteers will almost always want to just cp and paste a command string over the docs needed to walk someone through doing it in the current version of GUI.
I’ve done both. Repeatable user instructions for GUIs IS NOT FUN. Maybe if we can get some automation to turn vague directions into detailed ones and better yet testable (supporting something like OpenQA) it might help lower the burden for a project to do so.
“Do not let has been burden what could be.” /s
I agree though, other common UX replication options would help user meet the OS where they are more. I also agree that most common system administration and user UX should be doable in a full GUI, they are just so nice for when you don’t know what you are wanting but will once you see it.
I also think VUI (voice user interfaces) would bridge the gap for a lot people and NLP would cover most of the worlds population.
Honestly people keep working on and it ebs and flows in progress. Its just a lot fing work to do it well. One day we will get to doing most functions with multimodal interface support (GUI/CLI/API/VUI/NLP/BCI?).
I have a mention in forward with a note being “the only documention left was a series of desperate sounding emails that the documentation was still on the now quarenteened work computers and something about a README”
THIS HAS HAPPENED TWICE TO ME, like I appreciate my bosses and PMs being chill and not wanting to overwork me on my way out but seriously guys I needed to hand this off to someone and put it somewhere. shrug
I feel like some function of actual measurements of say hormone levels over a given training period and lifetime would be a better classification systen over pure sex class system.
Most of the time it would result in the same divisions tbh, but outliers would be better accommodated and we get the added bonus of further breaking down gender roles.
Privacy is a foundational right. Without it inviduals suffer from the imbalanced power dynamic of the states resources.
Whoohoo! Great to see Vulkan really taking place as the norm. I hope this can help stream line development for some as it keeps happening.
Because not enough creative believe themaxisnm of “fuck you pay me”.
Religion is an opiate. The best way to reduce its abuse is by addressing the underlying pain. When people conditions get worse they look to things to help numb the pain.
None taken! I’ll check out AI Horde!
Is there any objective measured ways or at least subject reviews based metrics for a model on g8ve problem set? I know the white papers tend to include it and sometimes the git repos, but I don’t see that info when searching through ollama for example.
I saw you other post about ollama alts and the concurrency mention in one of the projects README sounds promising.
Very much pro Open Source AI. Especially as a concept digital public good. With https://petals.dev/ being the most promising option that regard (imagine something like RAG for the arch wiki with very large models supported by the community!).
It feel very enthusiasts right now. Where I feel like I’m just on the cusp of having usable set up.
I personally really want a full Dev that just takes gitlab issues and runs codes against tests until it passes, and then cycles between attempting to explain what it doing and refactoring until that explanation is reasonably simple, then submit PR.
At the moment I am trying to use it as a copilot (ollama lama3, continue, and devonAI vscode plugins) all on my MacBook (my Linux machine were too small gpu wise, at least first time I attempted). That said it ok for questions no real luck on a decent experience for actually making anything.
The next step to me for it to move from enthusiast to hobbiest would be:
I feel like there has to be a better way for this. Maybe its just selinux rules for data tags for locking down my local system and some routing config file at the root of my projects. Idk tbh
The Dick Van Dike show is a great one.
The Marvelous Misses Maisel
The game from the startreck like episode on BlackMirror and Sword Art Online! Both are arguably great.
The twilight zone episode about the podcast and the airplane is amazing too.