> Firstly, can there be an easier way to stop a microVM mid execution in this single executable bottlefire format and then rerun that and it would start mid execution. (something akin to how criu does it?)

Not yet - Firecracker supports snapshotting so this should be doable though!

> if something like microvm could be run in normal cloud infrastructure?

Some cloud providers - like GCP and DigitalOcean - do support nested virtualization, and they work pretty well with Firecracker. Using VM migration to run stable workloads on spot instances sounds very interesting :)

▲

tuananh 4 days ago | parent | next [-]

> Some cloud providers - like GCP and DigitalOcean - do support nested virtualization, and they work pretty well with Firecracker. Using VM migration to run stable workloads on spot instances sounds very interesting :)

not necessarily. you can build custom kernel with pvm[1] and do it on aws.

[1]: https://lwn.net/Articles/963718/

▲

Imustaskforhelp 4 days ago | parent | next [-]

Yes I also came to know across pvm. I feel like doing it on top of aws instances can bring a really nice way of migrating from spot isntances and paying less bills.

What are your thoughts on the other hand in using criu with docker and then deploying it on aws spot instances, is it possible

▲

tuananh 4 days ago | parent [-]

> What are your thoughts on the other hand in using criu with docker and then deploying it on aws spot instances, is it possible

I don't see why not really

but the last few years, spot has been reclaimed way too often and the price discount is not as good as it used to be (era 2016-2017) so I prefer to use saving plan now. although quite a big portion of our fleet still use spot.

	▲	Imustaskforhelp 4 days ago \| parent [-]
		hm that was an interesting take, I had seen this youtube video by codedamn [1] on how spot instances are really cheap and had always wondered why people weren't using this, well now I understand that the incentives have changed. Thanks for telling me, I didn't knew it or maybe the creator of that video had created it quite recently (10 months from now isn't that much of a time unless things have changed) Video [1] : https://www.youtube.com/watch?v=6hM4ZRIuD5g Have things changed quite a lot in 10 months or was it the author maybe overhyping the usecase I suppose. I am really wondering but is there any software stack that can work with multi cloud approach the best way. I feel like typescript is really great for such purposes for the most part, I hope that this doesn't get counted as too off topic. I am not a dev ops guy but I just like being frugal and checking different options etc. and I am just wondering what is the best "just works" cloud 2025 without being too much expensive like vercel or netlify. Have a nice day!

▲

codethief 4 days ago | parent | prev [-]

Wow, I didn't know about PVM! So this should finally allow nesting of container/VM sandboxes?

	▲	tuananh 4 days ago \| parent [-]
		yes you can now

▲

Imustaskforhelp 5 days ago | parent | prev [-]

I genuinely hope that you can please consider the 1st question regarding snapshotting and its doability in bottlefire's / bake's roadmap.

Regarding the 2nd question, I feel like something can definitely be crafted that can enable running stable workloads on gcp/digitalocean spot instances and maybe what bake can do is really make the automation aspect of spot instances / VM migration easier...

Please don't get me wrong, this project looks really cool but I would actually like a first hand response as to (preferably) why this/bake project was created and when/why should someone use this..

I also have many more questions and I feel like haivng a community place can be really helpful here.

Although my open source purist heart wishes for you to use matrix, Its also understandable if you use discord. Do note that there are bridges so you could technically have both matrix and discord and bridge them.

Best wishes for your project.