Information & announcements

cobito

A few hours ago, a PeerTube security patch was released that also addresses another vulnerability discovered three days ago. The Hardlimit instance was updated both three days ago and a few hours ago.

The vulnerability allowed code injection, SQL injection, plugin installation, and the exploitation of processing tokens to manipulate videos published by users. Additionally, they detected a manipulation of the Google Analytics domain that was reporting traffic data to an illegitimate site (we do not use this).

The checks recommended by the platform developers have been performed, and no signs of penetration or manipulation have been detected.

The instance is now secure against these vulnerabilities, but all user sessions had to be reset, so you will need to log in again.

cobito

Today's tasks are essentially complete.

The web proxy component has been moved to the VPS. Following this, cache testing has been underway, and it now primarily caches content from the Peertube instances (videos and images), the Mastodon instance, and the museum. This should significantly improve the loading speed of certain files, particularly the museum's emulations, image loading, and video playback under higher traffic. Additionally, this is expected to reduce I/O activity on the NAS and the other drives.

From a security perspective, this is a major change as it isolates the internet-facing machine from everything else: nothing else has direct external contact except for the proxy-cache, which doesn't actually store any data.

Regarding software, the following updates have been made:

Nodebb from 4.11 to 4.12 (improvements to the visibility of federated threads).
Peertube from 8.1 to 8.2 (ability to transfer channels to other users, along with fixes for several important bugs).
Mastodon from 4.4 to 4.5 (quoting other posts is now possible, provided the author allows it).

As for the hardware, XMP has been disabled on the Ryzen 9 9900X (dropping from 6400MT/s to 4800MT/s, a 25% reduction). This is done to lower the voltage from 1.4V to 1.1V and is purely a matter of thermals and longevity: if those RAM modules fail, we'll be facing a major issue. This will have a direct impact on the AI models. At the moment, while handling live tasks (processing them as they come in, without revisiting past ones), there is still spare capacity. Once the temperatures start to drop, we will switch back to the XMP profile.

cobito

The translator now handles federated threads. Until now, it wasn't possible to fetch them because NodeBB didn't expose any list that included these threads, but with the latest update, that has changed. As a result, you will no longer see the annoying "This post is being processed/translated..." message indefinitely. For now, it has been tested on some older threads (not all are included since we're running in "low power" mode), but it will be applied to all new ones.

Additionally, I've implemented a small utility I need for server management, which I'm sharing with you in case it comes in handy: visiting extra.hardlimit.com/ip will return your public IP as a plain text string, with no HTML formatting.

cobito

Quick update:

It seems the Nodebb team actually did handle the embedded videos in cross-posts correctly. It was my fault for not enabling an option. Since yesterday, they've been showing up in new threads.
We've brought on a new intern to process threads: someone named Smith. This is because if HIAL-9000 is both posting and processing the threads, it won't see its own threads during processing since they don't appear in its "unread" list (typical silly oversight that cost me almost an hour yesterday going over the scripts to figure out why HIAL-9000 wouldn't process its own threads ).

pos_yo

@cobito It's impressive everything you're implementing just "for fun". Great work, thanks!

cobito

Alright, last post of the term:

The end of the term is approaching, and with it, the holiday break, which will be longer than usual this year.

Benchmark

In the end, the benchmark has been left half-finished and will remain in beta for a few months. I want to keep adding features to it before finalizing it.

Basically, new features have been added to the interface along with secondary tools, but the Core remains unmodified despite receiving many changes that haven't been included. There are several decisions I still need to make.

The reason for not releasing more updates is that the program's code was (and to some extent still is) a genuine headache. It's much better now than before, but it's something that has been neglected all this time, unlike the rest of the pages, which have received some attention over the last 5 years. In fact, most of the Core's code was practically the same since the early stable versions (around 10 years ago?).

In short: many hours have been spent on invisible work, but it will help speed up the release of updates from now on.

It's been impossible for me to dedicate time to it in the last few days, so there probably won't be any more betas until after the summer.

Homepage

It's been the great neglected one. After experimenting with video summaries, I've seen that AI is superior to me in understanding, correcting, and condensing concepts. The homepage basically consists of writing a short news summary, which I've done manually until now. And honestly, after seeing that, I've developed an incredible amount of laziness to keep doing that task. It's like having a brand-new excavator with a full tank of fuel, sitting on its tracks, while a worn-out pickaxe and shovel wait for someone to pick them up to dig a trench. What a pain to dig a trench with a pickaxe and shovel! The downside of all this is that one of the homepage's purposes has been to show that there are people behind the scenes maintaining the site. Delegating the cognitive effort of this task to a machine will erase that "symbol" of activity in one stroke. On the other hand, I don't think it's necessary right now to show signs of activity just for the sake of it.

In general, the homepage has been something that hasn't motivated me much for a while, because it's hard to find real news (the world of personal computing is essentially dead), because sensationalism is the norm, and because sometimes you have to verify unlikely (but potentially true) information. It takes a lot of time and effort, and the value it brings is debatable. If a machine can do that job and even do it better than me, why not?

I still have to make the final decision, but it's highly likely that upon my return (sometime in September), the homepage will undergo a radical internal overhaul. It's the only page that hasn't received development hours in the last year, and since it's going to be redone, I think this is the way it will be approached.

Forum

I'm trying to inject some activity into it from the Peertube instance. It seems like the right place to publish text-based content, and in fact, I was considering migrating the posts from my old retro blog to the forum. I was also thinking about creating posts about thematic videos (The Computer Chronicles comes to mind right now) in a new retro subforum, since it's a branch with a lot of momentum at the moment.

In this regard, I'm still on uncharted territory. If social media and aggressive SEO ended the forum era over a decade ago, I'm pondering how a forum fits into the current AI era. Providing content as a starting point for discussions isn't complicated as long as there continues to be content generation on the Peertube instance. Being a Q&A hub remains a possibility for very specific and poorly documented topics. But attracting people to participate directly is a challenge.

We'll see if I can revive some old formulas...

Museum

It's been completely neglected this term. It remains the center of gravity for my interest because it's where I feel most comfortable experimenting without the fear of breaking things. But I can't leave the rest neglected, and besides, one also gets tired of always working on the same thing.

I'd like to shovel content in and push to the limit all the development I did a few months ago to see how it performs at scale, but the lack of storage prevents me from doing so. Still, I have some ideas to squeeze every last byte out of the 2TB allocated to this project.

Infrastructure

We have three urgent needs: more storage, more GPU processing power, and better energy efficiency. These are three machines that, as of today, cost an unaffordable fortune. During the next term, the acquisition of this hardware will depend exclusively on price trends, which puts us at the earliest in 2027.

Meanwhile, the hoarding frenzy by AI scalpers has greatly reduced to the point where, at the moment, we're running at nominal levels for both bandwidth and CPU usage. And to be honest, I'm genuinely curious to know the reasons behind this abrupt drop in activity compared to the momentum AI is currently experiencing, regardless of how beneficial this drop is for us. Knowing where personal computing is heading in the coming months directly depends on what the AI "industry" does, and given how extremely opaque that field is, having these discreet data points always helps a bit to understand the situation.

I don't have anything special planned for the next term: naturally, the benchmark program will be the priority. Essentially, I'll let myself be guided a bit more by whatever I feel like doing at the time (without neglecting anything and with some planning), and it will also depend on how feasible it is to purchase the planned hardware, since we're a bit limited in that regard at the moment.

If I can find some time, I might release a bit more until the first week of July, but not much.

Happy summer!

cobito

Last night, the hard drive on the Ryzen 9 9900X failed miserably. That left us without the forum or translations all day. It's been a disaster. I've spent about 10 hours getting everything back up and running, which involved finding a working hard drive, installing the system, and trying to recover the forum's database from the dead drive. It was impossible to recover the database, so I had to fall back on a backup from Saturday. That means any threads and crossposts created since then are lost.

For now, our bots (Smith and HIAL-9000) are offline. I need to get the entire AI infrastructure back online, which will be a slow process, so it'll be ready either today or tomorrow.

cobito

A PeerTube security update has been released and is already installed. It resolves high-severity security issues.

The details will be published in the coming days on the version tag.

cobito

We'll start getting things up and running little by little this term. The first thing will be to add to the database all the hardware that the staff has been validating on the test bench during the summer. I see quite a few processors, a good number of motherboards, and countless RAM models. I'll get to work on that in the coming days.

Software Update

The first major undertaking will be working on the servers. This will likely happen during the week of September 7th (the exact day will be specified later). Currently, all web requests pass through a caching proxy on a VPS. The initial idea was to reduce the load and bandwidth on the backend, but it hasn't worked as expected. On one hand, there are prolonged bursts of transfers between the backend and the VPS that saturate the connection (the exact opposite of what I intended). This is because when someone downloads a large file, the entire file is copied to the cache while being served. On the other hand, countless issues have arisen (mainly on the museum site) for reasons I still don't fully understand (it's my first time configuring Nginx's cache and there's something I'm not doing right).

That means we'll go back to the previous setup: using the VPS as a gateway to take advantage of its better connection routing, and that's it.

In parallel, the main server's OS will be updated (now acting as the backend). This operation is usually quite tedious and will likely take up almost a full day.

There are also pending updates for NodeBB (forum) and Mastodon.

Hardware Update

Regarding the current hardware, we'll be rotating hard drives. In recent months, a couple of drives have failed (one of them suddenly and disastrously). There's likely a methodological flaw on my part here: I've taken for granted that hard drives are permanent as long as operating conditions are adequate, and having backups has made me complacent. It's also true that the number of hard drives has multiplied over the past year: we used to just have the NAS and the system drive. Now, there are also dedicated drives for Mastodon resources, PeerTube, Redis, the museum, the web server, and the Ryzen 9900X. The probability of failure multiplies accordingly.

Anyway, after that, I was left without hard drives suitable for these tasks, so I've replenished the reserves (they aren't new, but have very little usage). I still need to figure out how to distribute the services and data, but that's irrelevant for now.

Regarding the hardware renewal campaign that was left unfinished last term, given the current situation, it won't be resumed anytime soon. A few months ago, I was hoping things would start normalizing around this time of year, and although there are signs of a cycle shift and some macroeconomic forces seem to be emerging that could help restore balance, the harsh reality is that it won't happen by 2026.

Development

I still don't know how much time I'll be able to dedicate to this over the coming months. I hope it'll be something similar to what I've been doing recently, but nothing is guaranteed.

Last term, the test bench project was shelved. Some beta versions were released, but issues arose when trying to reproduce results after making structural changes to the program (threading vs. process architecture). The initial idea is to keep the core intact for tests 1 through 4, add a new test (large memory) within a multithreaded framework, and gradually add features to the GUI. There are also pending details on the website (layout, graph aesthetics, and other minor issues).

In parallel, the homepage will be reimplemented to abandon the DBMS I originally created, which has proven a pain to maintain, slow, and insecure, in favor of migrating to the same structure used for the test bench and the museum. As for content, the idea is to experiment with AI (remember that at Hardlimit, only open-source models run locally are used). I want to run some tests to see how it works. If the results aren't as expected, we'll revert to the manual method. The idea is also to offer an English-translated version. All of this will require massive amounts of processing power, so that might be where the plan falls through. We'll see.

And to wrap this up, all the code related to forum translation and PeerTube subtitles will be refactored. This has always been done experimentally, in bits and pieces, throwing things together haphazardly. It has ended up resulting in a somewhat chaotic file and directory structure.

I also want to experiment with more flexible forum translations, meaning giving the model more freedom to split and merge sentences to make the translations sound more natural. Currently, it's instructed to respect the original text's structure, which sometimes leads to unnatural translations in the target language. It's a delicate topic (from the standpoint of preserving the fidelity of the information being conveyed), which is why I want to run some tests before implementing it.

The entire forum translation project will have higher priority than last term, as there's finally some activity (very little, but it's there), which leads me to believe that the number of English-speaking readers on the forum must also be increasing.

Anyway, there are more things on the back burner (promoting certain types of content on PeerTube, encouraging people to participate in the forum, pushing to use the Mastodon instance, etc.). But the current infrastructure calls for caution when pushing for even moderate growth in activity, especially on PeerTube. Since the ultimate goal is for everything to mutually reinforce each other, this has been put on hold for now.