Attention Is All You Need: https://arxiv.org/abs/1706.03762

https://en.wikipedia.org/wiki/Attention_Is_All_You_Need

From my understanding all of these language models can be simplified down to just: “Based on all known writing what’s the most likely word or phrase based on the current text”. Prompt engineering and other fancy words equates to changing the averages that the statistics give. So by threatening these models it changes the weighting such that the produced text more closely resembles threatening words and phrases that was used in the dataset (or something along those lines).

https://poloclub.github.io/transformer-explainer/

It doesn’t make sense which is why people believe Google has ulterior motives. I haven’t seen any real reason not to use jxl as the new format; but I also haven’t looked that far into it. ¯\(ツ)/¯

You might have grabbed the wrong iso. There are two ISOs for Ubuntu, one is desktop which comes with a desktop and the other is server which only comes with a text console.

You can install a desktop onto a server image if necessary, however I would recommend just using a desktop iso and don’t bother with adding on and setting up all the desktop software.

If you want to be able to select text, copy and paste, I just SSH from Windows Terminal or Mac iTerm2

Alternatively if it is a desktop iso then you might have accidentally installed a package that broke things or have gone a tty interface. There’s so many different possibilities it’s going to be hard to help more.

I mean yes they all build off each other. However, the basis for all science is logic? You take logic and observation and you use math and other previously proved physics ideas to create concrete proofs, then use more logic and observation to prove your findings. Repeat forever.

However, I said computer science, which outside of the physical hardware it’s entirely just math and logic. Yes, when trying to get performance the logic you look at includes the hardware and all its design and limitations. However, it’s not needed for most people or even this conversation. It’s an included practice when talking about computer science and isn’t necessary to mention it.

Pure computer science is entirely about using the hardware given and making logical decisions utilizing math to move and generate data in efficient ways. Some intersection occurs here when trying to do say, realistic physics simulations, RNA folding simulation, molecular simulation, etc. Those do inform each other but mostly about how to reduce the math complexity while still generating accurate enough data.

For the person designing CPUs and all the support hardware, then physics influences their designs by a lot which is where the real intersections begin.

Logic is the entire concept and point of Computer Science which builds completely on top of math.

Future of AI is definitely going towards Manager/Agent model. It allows for an AI to handle all the tasks without keeping it to one model or method. We’re already seeing this with ChatGPT using Mathematica for math questions. Soon we can see art AI using different models and methods based on text input.

Kinda funny that rather than explaining how toilets work you try to compare it to circuits, which I’d take a guess and say that a majority of people don’t know how they work, lol.

It’s really quite fair that FSR and DLSS don’t look great at 1080p since they weren’t designed for that use case at all. Ideally it’s meant to upscale to 4K where the base resolution is at minimum ~1080p where’s there’s enough pixels to get a good output. When trying to upscale to 720p or 1080p the base resolution goes down to the 300ps (maybe even lower) which just isn’t enough that least with todays models.

So for me I don’t see FSR or DLSS being a solution at all the hardware question for longevity. To me it just allows a weaker GPU to look nicer on a 4K screen (theoretically) not to increase FPS as a main feature.

Maybe GPUs could get cinema upscalers? I don’t know how they work or feasibility other than for a while 4K Bluerays we’re just the 2K footage but ran through these upscalers.

It’s really quite fair that FSR and DLSS don’t look great at 1080p since they weren’t designed for that use case at all. Ideally it’s meant to upscale to 4K where the base resolution is at minimum ~1080p where’s there’s enough pixels to get a good output. When trying to upscale to 720p or 1080p the base resolution goes down to the 300ps (maybe even lower) which just isn’t enough that least with todays models.

So for me I don’t see FSR or DLSS being a solution at all the hardware question for longevity. To me it just allows a weaker GPU to look nicer on a 4K screen (theoretically) not to increase FPS as a main feature.

Maybe GPUs could get cinema upscalers? I don’t know how they work or feasibility other than for a while 4K Bluerays we’re just the 2K footage but ran through these upscalers.

Private sites that people upload torrents to. A lot of them have requirements like “upload at least 1 content that we don’t have” and “must maintain a seed ratio of x”. Most that I’ve seen either have closed registrations, requiring someone to invite you as a referral, or they have interviews to make sure you’re not malicious”.

I’ve always wanted to be in one because every once in a while I can’t find content that’s old/obscure and it’s super annoying and supposedly private trackers have a bunch of old/obscure content as-well as super new stuff like blu ray rips and native stream rips.

Hmm, I haven’t delved into image training in a couple years so I’m assuming they still downscale images anyway, so I’m not sure how much the format helps? Do you know if better compression helps at lower resolution? I could see it helping but I could also seeing it be marginal gains and depending on processing time it might not be worth it to convert whole image sets to jpeg xl. And for performance does jpeg xl require less power/time to decode than other formats? Maybe for new image sets going forward it will be the standard.

It is when you’re a cloud hosting platform and you have 1000’s of photos uploaded daily. That 44k saving scales massively when talking about cloud hosting platforms. The jpeg xl format license is more open than webp which is controlled by google.

The new format also enables more features than just file size, a quick google shows it supports animation, 360 photos, and image bursts (as well as more technical specifics that allow for better share ability without needing to have an accompanying json file or dropping to RAW).

This is more important because it means websites can embed photos and the web engine whether it be chromium, Firefox, or safari can handle it natively without needing JavaScript or some other intermediary.

What about png? It’s just another competing standard. At the end of the day it doesn’t really matter, but by not having competing standards we end up having one company controlling it. So since at the very least it gives a decent file size saving it’s good enough for me.