Is LinkedIn a normal social network? It seems like an absolute dumpster fire to me (it even has shorts now!)

I’m quite happy that my friends have labelled me as “an absolute idiot with anything but computers.” It’s much easier to relate to people at that level, adopt a happy-go-lucky attitude, and being wrong about 99% of things. being the smart one isn’t such a great label, and is (mostly) all in your head

It’s 27b active params vs 13b active params, so you’d expect it to be 2x more expensive when serving multiple users

And the goalposts must move once again..

I think this comes in with the wrong assumptions from the start. The thing that US vs Apple taught us is to not demand access publicly, this puts companies in an awkward spot. If approached more tacitly, gag order etc the company has nothing to gain but everything to lose.. and more likely to comply. I hugely doubt that intentional backdoors don’t exist for the most powerful countries / people

Bit of a counter point, but I ran a very nice wfh setup at a previous job, 4k monitor and ergo keyboards. I was a bit dismayed when I joined a new co and found that we had 1080p monitors and a generic Logitech keyboard. After a week of the text looking pixelated I entirely got used to it and think maybe complaints about monitors being a health hazard and rsi are a tad overblown by a vocal minority.

Stylistically ugly code that is globally consistent (ideally across the entire ecosystem) >> locally beautiful code that is inconsistent with the rest of the codebase / up to authors taste. No one likes black formatting, but it’s at least consistent. “Your car can be any color you like as long as it’s black”

With regards to your example, adding a comma to the final element should preserve multi-line. You just don’t know the formatting rules yet apparently

1.0 is actually pretty arbitrary and way too high as a general rule. Something like 0.3 is a more sensible default

1.0 is "natural units". If your energy corresponds to nats, you should be using temperature 1.0. If your energy corresponds to bits, you should be using temperature ln(2) ~= 0.7. The optimization pressure is

     max nats = max entropy + energy / temperature

Why might energy correspond to bits or nats? Imagine your goal is to play as many interesting games of chess as possible in a tournament. This implies you have to keep winning. If you look at the RL environment from the right perspective, you can turn it into optimizing bits or nats.

If RL was used to train the model, the model will have been trained on its own sequences. Those will have been generated with a temperature of 1.0. They must be, otherwise you would get a premature collapse or explosion of your entropy if the temperature was respectively lower or higher.

After that RL step, you want to stick to the RL distribution, and so keep a temperature of 1.0. Other temperatures will drive the model out-of-distribution.

That is why the sampling step for agents or thinking LLMs are usually kept at a temperature of 1.0.

It really depends on the application does it not? I'm not an LLM guy, but for creative tasks like storytelling wouldn't you want a higher temperature usually? Happy to gain insight from anyone with experience here :)

Heavily depends on the model architecture and the implementation though, I don't think you can say what values are better than others without first specifying those, otherwise it's straight up guessing, ironically.

If you use a model in a configuration far from where it was RLed you get no warranty. (you also get no warranty the other way, however)

And yet the monologue is a complete work of fiction, a script delivered by a talented actor that we still find moving. So what are these authentic experiences to you, or does it not matter if we can’t tell the difference?