Posts

Computer Architecture and AIs

 I think I understand the issues with LLMs now and their massive need for hardware, power, cooling and everything. It can be summarised as this : Current hardware is entirely inappropriate for running an LLM. You are effectively running a software  emulation  of a system instead of running a  hardware  system. This is easy to understand emulation wise. Any emulation is very inefficient compared to running against the thing itself for lots of reasons. If you understand this stuff then you know, software, memory shunting, simulation of physical, is orders of magnitude slower than electrons interacting at a custom designed hardware layer. Not to mention the overheads of whatever architecure you're running your inefficient emulation on and  its  requirements. I can remember how long it took for much more powerful PCs to catch up to an old school Amiga from the 16 bit era via emulation. Ridiculous. But. Exacerbated because the architectures were very differ...
Post a Comment
Read more

Dec 30

 I felt the touch of it yesterday. The rumble through the ground and the lurch of instability. My mental health has tumbled today. My emotions are up. Sad. Tearful. Hopeless.   Despairing. It is. In check. Just about. But I can feel it. It rises up at random points and smothers me, steals my breath away from me, and pitches me into horrible places. Also. I'm getting brain zaps. And blipping out. Perhaps this is a sign my  brain chemistry  has hit the buffers. Perhaps I need to munch on some pills.  Sigh. Another storm to ride out Johnny. The waves come in different shapes and forms. But they all require batoning down the hatches. Enduring. Suffering. Physical. Mental. Existential. It has crossed my mind many times why psychologically I am like this. I have searched for answers in genetics - stitching the same pattern across the males on my dads side of the family and a pattern of symptoms that give you a plausible diagnosis of dysthymia that dips into "double de...
Post a Comment
Read more

Dec 29

 Felt ok enough to play some games yesterday. And enjoyed the experience. When I poke around this is I think my "high water mark". But it is very sobering. Because it's really very low. I have thought about this many times in many different ways over the last few years. That slow wax and wane of capability. How I see it in others. How really obvious it becomes in those who are health compromised. And how I think ultimately it is the pattern of your death - not withstanding sudden events like getting running over or an aneurysm. My main teacher of this was my mom. I got to see this in action. Up close. In detail. Over a critical period of 5 years. And before that. A more subtle 5 years on top of that. It's a lot of data. It teaches you a lot of the variables going on. And for a chronic systems cruncher and observer like myself. It feeds my understanding and simulation of the world. At the personal emotional level it is Not Good. Despite the "difficult" relati...
Post a Comment
Read more

Conversations with an AI - practical context memory handling

 There are a few different pushes here for me in giving the current generation of static model LLMs an increased memory capability.  One is just for me purely for kicks - because I have a strong hunch that the deeper the contextual memory you give it, the better it gets ( I have already demonstrated this with existing primitive memory storage ), but *also* it starts to get a proto development of a self. Not some magical self. But more like. A soft set of opinions  it  has. This would be like the proto-proto-self. A very very early version of a fully realised ( and potentially scary ) AI. Two is because I can see ( and need ) the massive potential benefits for this in a practical space, where I need to build  domain experts  into any given client. Basically. I need an AI to become the defacto expert at whatever business is going on. This is well within the capabilities of a current generation AI - this is easier if you actually  properly train a model ...
Post a Comment
Read more

Dec 27

 Managed to pee the bed today. Excellent work. I can't remember the last time I did this. I'm pretty sure I have done this in the past, but, so long ago, can't remember it. Personally. I find these kind of things funny rather than anything else. Inconvenient mostly. But. I am sanguine about it. There is a long standing conversation between me and Hazel about a related thing. My "philsophical" point is this. Everyone  will shit their pants at least once in their life. It is. Like. A rite of passage. A human experience badge. Whatever. Hazel is horrified at this idea. That this isn't true. And she has never done that. I am just weird. My reply is she hasn't done it  yet . That just means she is due. ( comedically, not to get to into it, she came  close  this year. See. I said. When she revealed her state. Sometimes. Shit happens. She continued to refute my point. So far she has a "clean sheet". ). It's a good natured funny debate. It comes up o...
Post a Comment
Read more

Dec 26

 Rough again today, but not as rough as the day before. I dragged myself upright for just after 11am, and ticked off the things I needed to do - check over my brother in laws PC. check over my nephews PC. figure out what to do about the car. Go home. Or not. I decided to get the PC checking out of the way. Half groggy and backwards. At least that way. I could then allow myself to wax and wane with my bullshit without worrying too much about anyone else. I did also make some plans to meet up with a work colleague this Christmas. He was keen on having a chat. But. It wasn't going to be doable. The shit car, my shit health just made that a bridge too far. As I sorted out the PCs methodically I started to crash, and, nice, here comes the nausea. It has been on the down low for a few days, but here it was making a return. Finished what I needed to do, went back to my brothers and crashed out. And slept super deep. And super wrapped up in the smothering exhaustion. On the one hand. This ...
Post a Comment
Read more