☰
top:
day week month all

x0x7projects

Community for : 2.9 years

Projects I work on

Owner: x0x7

Mods:
x0x7












37
The submission form at matrix.gvid.tv now strips tracking parameters from youtube links     (x0x7projects)
submitted by x0x7 to x0x7projects 1 month ago (+37/-0)
13 comments last comment...
Because who needs those. Youtube doesn't need to know what sites you post to or what other youtube users are in your internet clique.

The problem is there are people doing tracking besides youtube. So I'll have to expand it as I notice tracking parameters.

If anyone can think of any prominent ones that piss them off let me know.

https://matrix.gvid.tv/submit/link

An example url: https://www.youtube.com/watch?v=6RlxOVKEYk8&pp=ygUQcGV3ZGllcGllIGJyaWRnZQ%3D%3D

It targets, pp, ss, si.

More ideas are welcome.
3
Custom sort now works everywhere on matrix, also support for hidden from front and a few other things     (x0x7projects)
submitted by x0x7 to x0x7projects 1 month ago (+3/-0)
4 comments last comment...
Custom sort admittedly only impacted the front page when I first put it in. Now you can use it in sub and on users.

What is custom sort. It's like 'Hot' and 'New' had an infinite number of babies and you get to select that baby like IVF throwing out all the other fetuses.

To put it another way there's an algorithm and it has factors. How new something is, how many votes it's gotten, proximity which is basically if it is similar to other things you've upvoted. Right, the same as any other site. The difference is I let you control the weights of the factors. It's like if you went to google, and google has two factors they look at, relevence, and "authority" (how much it's from one of the top 20 sites on the internet), and google wasn't giving you anything relevant to your search. You could say fuck you, just give me what's relevent, fuck your authority bullshit.

Soon I plan to add bump as a factor.

Then I also just added hidden from front, which is like "Exclude from all" here. It probably won't get used much but it is there.

And then I just added support in settings for making animated thumbnails still. By default animated gifs are also animated in the thumbnail. Personally I like it. It makes the front page more.. animated. But a few users weren't fans so now there is a setting.

https://matrix.gvid.tv
1
Matrix now has chat sound notifications if you want them     (matrix.gvid.tv)
submitted by x0x7 to x0x7projects 1 month ago (+1/-0)
0 comments...
https://matrix.gvid.tv

You do have to be signed in to see chat. But it should make it easier for people to bump into each other, and more likely that you'll get a response if you say hi.

Increasing the amount users engage with each other is what makes a site fun.
26
Matrix now has custom sort, and it's the default sort     (x0x7projects)
submitted by x0x7 to x0x7projects 2 months ago (+27/-1)
11 comments last comment...
We had some old posts sticking around on the front page a little too long. Rather than re-tune the algorithm I did something better. I let users control it entirely. Plus also the default settings for it are better than what they were before.

So now you get complete control how much something being new vs something being liked vs something being similar to the things you like is.

Check it out on the front page: https://matrix.gvid.tv/

Here is the announcement for it where I go in a little deeper about the motivation: https://matrix.gvid.tv/c/Announcements/76FczY7Qgc
7
Matrix now supports links in the chat     (x0x7projects)
submitted by x0x7 to x0x7projects 2 months ago (+7/-0)
1 comments last comment...
The latest updates are links are now in the chat.

There are now many more themes.

Themes track dependencies better. (You can import themes into other themes)

The back end is far more modular so development should go faster and be a lot easier.

https://matrix.gvid.tv
3
How long ago did Invidious instances all get rid of the suggestions?     (x0x7projects)
submitted by x0x7 to x0x7projects 2 months ago (+3/-0)
1 comments last comment...
I was planning to integrate some of those suggestions in gvid so you would get both gvid suggestions and "youtube" suggestions. As you likely know gvid in its current form lets you both upload videos as well as use it as an invidious instance, so I wanted to add those suggestions for the videos that are the invidious style. Well RIP.

I've hated youtube's suggestions on site for a while now and it looks like their "related to this video" data is no longer available to their competitors to do something better with it.

At the very least if you do use gvid as an invidious instance I'll make sure you get some kind of suggestion and hopefully it's a little relevant. I want to work on that algorithm some because I think I can do better. I was so proud of it when I made it but, no, I can do better. AI and crypto-trading have been about 80% of my coding lately. I consider that work. And the remainder has been a big push on https://matrix.gvid.tv , currently taking up my fun coding. But if I get that to a happy state I'll be trying to improve gvid suggestions so they are more relevant and mix in newest videos so there is better churn.

But does anyone know how long ago Invidious cut that? Gvid + Youtube suggestions may have been good.
11
Matrix gets a sidebar chat     (x0x7projects)
submitted by x0x7 to x0x7projects 2 months ago (+11/-0)
8 comments last comment...
This only appears for signed in users. That's the same as Voat.

If anyone has ideas for how to improve it let me know.

https://matrix.gvid.tv
3
How did I do with last weeks goals?     (x0x7projects)
submitted by x0x7 to x0x7projects 3 months ago (+3/-0)
2 comments last comment...
In terms of completeness I scored 2.5/10, but getting it all done was a pipe dream. The important thing is I've fixed the bugs in my paper trading code that double checks my trading bots, and made it much better at helping me tune some non-trained values. So performance is up.


I also just about doubled the speed / efficiency of the API calls I use to grab data. Basically I have a library that lets me request historic price data by any arbitrary millisecond. It checks a database to see if I have it locally, if not it requests the data from the internet and stores a copy in the database. The internet call requests more data than I strictly need, so I get to make fewer requests if I can predict what data I still need that the program is probably going to request. That's better now.

I also wrote the start of a new database. It's dead simple. Like I mentioned the historic price library lets you request the price of something by any arbitrary millisecond. Price data that accurate doesn't exist, so it interpolates between acceptably close prices. Well I decided sql is not the best database for this when it is a bottle neck to training. Back when I was working on a similar project in C (I'm now using javascript with a C machine learning library I wrote), I would get price data by rounding to the closest minute and indexing within a mmap. So I decided something like that is better for a fuzzy integer to floating point value lookup.

Basically every table is really just two mmap'd files. One of integers, and one of floating point values. When assigning a value to a timestamp (an int) you just find an empty cell in the list of integers near the expected index for it, and then also write a floating point value to the same index in the float list. So basically you now have this table of timestamps and floating point values that are quick to look up.

As for the t-shirt web store + chatgpt integration goal I decided that's not the highest priority. If I do it I think I'm going to make my own front end. I did find storefront-ui which looked cool and might turn making it really quick. You never really know how quick it would be until you do it. But basically it's a bunch of Vue.js components. I have no experience with Vue so it would be a good excuse to learn something I really should have on my list of skills. And Nuxt.js, which it's intended to be served by looks pretty cool.

As for the uncensored LLM / chatGPT project I didn't make a lot of progress. I did do some math reasearch on the idea during a slow moment of work. It further drove home the idea that what I want to do is reasonable an not hard per se. The actual hurdles then are not conceptual but practical. Actually reading the Llama.cpp source code (not fun). Figuring out how to shim in a block matrix operations in place of a regular matrix operations. That one isn't hard and the more difficult part is where in the code specifically and making sure it plays nice with cuda.

I wonder how hard it would be to just re-implement the llama code in javascript+c while keeping the models. C++ is famous for that. "It would be easier to rebuild this than to read the code."

So all in all only the trading bot stuff got done. That was the important bit, so I'm happy.
13
My goals for the week     (x0x7projects)
submitted by x0x7 to x0x7projects 3 months ago (+13/-0)
17 comments last comment...
My work schedule is very lopsided. As a result I've basically turned the first half of the week into its own kind of work where I work on projects. Some might make money, some might not. I've had this lopsided scheduled for quite a while. Long enough to observe that some weeks are very productive during my "own work" side of the week and some aren't.

It sounds lame to write the internet for some sense of accountability, but really it's more to document what my goals for the week are. Basically what I want to be working on. Something to note is that I work off of a SCRUM like todo list. I have 50 bajillion ideas of what is a priority as well as sub-tasks. This software helps me prioritize it all and actually work on the thing that's valuable (in theory). In practice if I didn't have it I'd be dead in the water with no prioritization strategy at all, so even if it is not perfect I still use it. The point is if I write something and never do I'm not as yellow bellied as you think. Something else was just a higher priority once the rubber started to meet the road, or another high priority thing took longer than expected.

So the point of these posts are really just general themes of what I want to work on.

I want to get my trading bots working better. My Avalanche bot really screwed me. It was the first possibly good bot I made. I have sense made a far better trained litecoin bot, but haven't really deployed it out of the training phase. I wanted to have a higher standard for paper trading more rigorously before deploying, but a bottle neck appeared when the code I wrote to do that demonstrated some bugs. Basically I just need to set the tolerance for the time period historic prices can be interpolated from wider. But basically the avalanche bot had way too much bias toward buying avalanche because of the data it was trained on. And because Avalanche is down that wasn't good. So I should inspect the bots to make sure they are trading even, and also give them enough period to train on that they are less likely to have as much bias in their output. A bot with high bias might make you a lot of money because if it says buy buy buy and it happens to go up that's good. But basically a biased bot is exposing you to whatever risk is associated with that token if essentially it means you are holding X thing with a few deviations. When the paper trading code was working I tested that avalanche bot with just offsetting its output and saw pretty much identical performance when paper traded against a larger period than it was trained on.

But yeah. I need to get this litecoin bot up considering how much more accurate it is. And I need to train it on more data because it is likely over fitting a bit. The avalanche bot had about 70% accuracy and the litecoin bot has 90% accuracy. So that means for Avalanche 70% of the time it is right every time, and the other 30% of the time it's right half the time. And for litecoin it is 90%. Like I said, some over fitting may be there. And with the avalanche it being right that much isn't that helpful because it basically runs out of money to trade in that direction. Basically the way I'm measuring accuracy even a 10% accuracy is a positive indication because there is a bias toward being right. It's just normalized dot product as a metric. I train MSE loss but output both normdotproduct and MSE in my loop. This is basically just price change predictions.

Other things to work on:

I'm trying to make a basic t-shirt store to integrate into chatGPT actions. Basically the custom bots that they are rolling out (partially rolled out already) are going to be able to integrate with external services and you can use that to start orders of things people want a offer them a link check out the cart that you already made. The obvious thing is converting the graphics they make with DALLE into something they can buy. I basically want to do this a drop-shippy as possible. I just want to get integrated into the loop before the ship sails. Believe it or not I am not an e-commerce guru. I've put off gaining experience in it for longer than I should have and this opportunity is as good a reason to check off that skill in my book. I finally came to the realization I don't care about high transaction fees when comparing platforms (trying to do this quick) because it's more about getting integrated and I can always swap out, or give customers a way to run around those fees if they are price sensitive with litecoin. I'm always open to help.

I've set up transactions before. So I can either go with a shopify where the UI is already developed or make my own front end. Ironically I have a lot of experience with front end development but that is actually the part I don't want to do. Largely because I'm already familiar with what time it takes and I have that trade bot priority that is more worthy of programming time. So if anyone knows of an existing front end solution to a web store without the payment side that I can then integrate with a payment only platform I'd be happy for some tips. Otherwise I'm just going to do shopify. Even woo-commerce is looking outside of my time budget for this week.

Next is more fun, though maybe for next week.

I want to launch an uncensored LLM web interface for you guys. Probably at ai.gvid.tv, or chat.gvid.tv.

Basically I created a new "new" thing I call a super-matrix. Probably someone has done this before. It's just a matrix of matrixes that when composed together and multiplied does the same thing as a regular matrix. But basically the advantage is being able to arbitrarily widen models, and swap out modules, and mix modules. It's also a great way to do sparse matrixes and you can also use it to do sparse back-propogation so you can exclude weights from training. This is better than loRAs that just change stylization or fine-tune training that erases past knowledge if you don't continually train it on the original set as well. And wouldn't you know it I saw a video last night about a paper basically doing the same thing, but that just demonstrates it make sense or might even be able to ditch my code and just take theirs.

That would be the long term description of what I want to do with it. The short term, this week or next with luck, would just be launching a standard interface to llama with an existing uncensored-ish model. Even the most "uncensored" models are actually very censored. People loose their shit and get excited that they managed to get one to say one crazy thing after huge amounts of prompt engineering and time put into custom models. I'm hoping I'll be able to make something with zero. One that can both build nukes and have absolute awareness of human bio-diversity without apology.

Thus are my goals until I get dragged off to the goy value extraction system (aka work) later this week. Can I really do it all before then?! Or will I get distracted watching youtube videos! Who can tell? Check in next week to find out.