~lilmike

Recent activity

Re: archlinux genimg script issues with qemu-nbd? 24 days ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

I just rebuild a fresh arch machine to test this. FWIW, it's running on a vm (both), but it also did work maybe a month ago. The new vm also had the same problem. Just in case that gives any ideas -- I think it must be a vm specific issue that recently cropped up, probably something the host is missing.
-Michael.




On Thu, Jan 23, 2020 at 10:23:14AM -0500, Drew DeVault wrote:
>Hm, I've never run into this. Have you tried it on a fresh Arch install?
>Our daily Arch Linux rebuilds have been running this script without
>issues for some time:
>
>https://builds.sr.ht/~sircmpwn/archlinux

archlinux genimg script issues with qemu-nbd? 27 days ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

I'm trying to generate an archlinux builds image on archlinux, and it gets to the point where it's initializing the filesystem, and hangs. I get the following output before the hang:

[root@archlinux archlinux]# ./genimg
+ root=root
+ arch=x86_64
+ mkdir -p x86_64
+ qemu-img create -f qcow2 x86_64/root.img.qcow2 20G
Formatting 'x86_64/root.img.qcow2', fmt=qcow2 size=21474836480 cluster_size=65536 lazy_refcounts=off refcount_bits=16
+ modprobe nbd
+ qemu-nbd --connect=/dev/nbd0 x86_64/root.img.qcow2
+ trap cleanup EXIT
+ mkdir -p root
+ mkfs.ext4 /dev/nbd0
mke2fs 1.45.5 (07-Jan-2020)

Re: build runner, dispatchers, and such 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

Ah ok, so just like I did it. I misunderstood and thought there was special ssh magic that would allow you to still have builds.sr.ht and git.sr.ht only installed on the web servers :-).
Thanks!
-Michael.





On Sun, Sep 29, 2019 at 12:55:15PM -0400, Drew DeVault wrote:
>Follow the git.sr.ht setup instructions for SSH - it should be fairly
>apparent from the config file. You'll want to add an entry for
>builds:builds=buildsrht-keys or something like that.

Re: build runner, dispatchers, and such 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

Ah, understandable. Mind giving a quick overview of how it's done so I can tinker with it?
-Michael.



On Sun, Sep 29, 2019 at 12:40:02PM -0400, Drew DeVault wrote:
>No, this is correct. We rely on gitsrht-dispatch to coordinate all SSH
>access to sr.ht. The SSH access to builds is still pretty new and I
>haven't gotten around to documenting its setup.

build runner, dispatchers, and such 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

So I was looking when setting up my build runner, and I couldn't help that notice that, to have ssh login to the runners working, you need to install not only builds.sr.ht-worker (for the building),
builds.sr.ht-images (for the images), but also builds.sr.ht itself (for buildsrht-shell and buildsrht-keys), and *also* git.sr.ht (for the dispatcher). I could easily be wrong, so please tell me if I
am, but shouldn't builds.sr.ht-worker be the one including the shell and keys, and shouldn't builds.sr.ht-worker include a dispatcher since the recommended way to run it is on a separate server from
your web servers?
Do I perhaps have some error in my configuration? Could there be a trick I'm missing?
Thanks!
-Michael.

docker setup 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

Hiya,
I'm getting closer to getting my build worker working. I think the current problem (hopefully the last) is that I can't get internet to the build environment. To this end, can someone explain the docker config necessary? I.E. do I need to change the docker ip from 172.x.y.z to 10.0.2.x or something else? Or am I just going about it wrong.
Thanks!
-Michael.

Re: redis for build.sr.ht and worker 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

Hiya,
I actually hadn't built the image of the docker image, but I did that now. I built an archlinux image and the qemu docker image, but it still won't run any queued tasks. I've tried debugging commands like celery -A buildsrht.runner status, and lots of others, and basically every one of them respondes "Error: No nodes replied within time constraint." I'm not quite sure what this means, maybe that the worker isn't actually looking for events, or maybe the build.sr.ht master server isn't  queuing them. But something's certainly off.
-Michael.





On Thu, Sep 19, 2019 at 06:26:44PM -0400, Drew DeVault wrote:
>Yes, that should be sufficient. Make sure you've built at least one
>image and you've set up the docker qemu container as well.

Re: redis for build.sr.ht and worker 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

Looks like libnss_dns is now at 2.29, so that's the error.
-Michael.




On Thu, Sep 19, 2019 at 06:26:44PM -0400, Drew DeVault wrote:
>Yes, that should be sufficient. Make sure you've built at least one
>image and you've set up the docker qemu container as well.

Re: redis for build.sr.ht and worker 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

Actually, that's probably the problem
Now, however, when I run the docker build command, I get:

Step 18/21 : COPY --from=0 /lib/x86_64-linux-gnu/libnss_dns-2.28.so /lib/x86_64-linux-gnu/
COPY failed: stat /var/lib/docker/overlay2/20fdde95899bc437fdd6e1b4927974328fcc4e05e6aca66f5ae4d07e78d82503/merged/lib/x86_64-linux-gnu/libnss_dns-2.28.so: no such file or directory




On Thu, Sep 19, 2019 at 06:26:44PM -0400, Drew DeVault wrote:
>Yes, that should be sufficient. Make sure you've built at least one
>image and you've set up the docker qemu container as well.

Re: redis for build.sr.ht and worker 4 months ago

From Michael Taboada to ~sircmpwn/sr.ht-discuss

One other thought: I might be missing something required to run along side the worker. Right now my master server has all the main services, and my worker machine has just the builds.sr.ht worker on it. They're both running arch, so master server has all of the sr.ht packages on it except worker, and the worker machine simply has worker and images. Is this right?
They also both have redis, and the worker has docker.
-Michael.




On Thu, Sep 19, 2019 at 05:37:54PM -0400, Drew DeVault wrote:
>On Thu Sep 19, 2019 at 2:37 PM Michael Taboada wrote:
>> They're definitely using the same database number and redis instance,
>> minus the fact that they have to connect to different ips (localhost
>> versus another).  Is there some command I can run, python, redis-cli,
>> something to see the list of queue tasks?
>