Memory usage builds up and shuts down vtltape

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Memory usage builds up and shuts down vtltape

Laarkie
First I'd like to thank you for a great project!

My Linux skills are improving thanks to mhvtl. :)

I'm using mhvtl with DPM 2010 and it works great with small backups and restores.

Today I think I found my problem.
When trying to restore a 30gb Bare metal recovery. The memory usage eats up my 6GB RAM and 8gb swap and then the vtltape process quits.
Is there some way to limit the RAM vtltape uses?
Or "flush" the data as it leaves the mhvtl computer to make room for more?

I'm using the mhvtl-1.1 with the lzo "patch". The behaviour was the same before lzo but then I couldn't figure out why it crashed.

Best Regards
Laarkie
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: Memory usage builds up and shuts down vtltape

Mark Harvey
Many thanks for the bug report.

It sounds like I'm missing a 'free()' call after decompressing the data. Let me check it out.

It's nice to see mhvtl can also provide other functions (like provide a reason to learn Linux :) ).

Cheers
Mark
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: Memory usage builds up and shuts down vtltape

Mark Harvey
I've just pushed this patch into github.

However, I would appreciate it if you could test this patch and confirm it resolves your crash

0001-Fix-memory-leak-in-lzo-decompression.patch
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate
star

Re: Memory usage builds up and shuts down vtltape

Laarkie
It worked!

I tried the exact same restore and the ram usage didn't increase.
And all vtltape processes are still up.

All the data didn't restore ok but maybe that also has to do with a similar bug?

I'll do another big backup and see if it's better.
I've had a lot of succesful tests with 1 - 15gb backups.
This was the first test with a +30gb.

Great software and awesome response.

Have a great weekend,
Laarkie
Loading...