For Large Files: Quick Note about Compression (RAR vs LZMA)

A hub for everything related to NBA 2K12 modding. Releases, previews, requests, and other modding discussion belongs here.

For Large Files: Quick Note about Compression (RAR vs LZMA)

Postby Leftos on Sat Jan 07, 2012 6:49 am

Just a quick note to all modders, especially those who make big update packs, regarding the comparison of compression algorithms.

Single Jersey
Uncompressed: 3.97MB
RAR (best profile): 1.06MB
LZMA (maximum profile): 0.93MB (12% better)

5 Jerseys
Uncompressed: 19.6MB
RAR (best profile, solid): 4.64MB
LZMA (maximum profile, solid): 3.25MB (30% better)

30 Teams, 75 Jerseys
Uncompressed: 294MB
RAR (best profile, solid): 68.5MB
LZMA (maximum profile, solid): 35.8MB (48% better)

So, obvious result, LZMA offers much better compression on those uncompressed IFF files, offering almost half the filesize on a big 30-team jersey update pack. You'll save both your and your end user's bandwidth, by switching to 7-zip, and thus, LZMA.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5223
Joined: Sun Jun 07, 2009 7:44 am
Location: Novato, CA, USA

Re: Quick Note about Compression (RAR vs LZMA)

Postby Andrew on Sat Jan 07, 2012 9:47 am

Good to know, thanks for the comparison. :)
User avatar
Andrew
Retro Basketball Gamer
Administrator
 
Posts: 113954
Joined: Thu Aug 22, 2002 8:51 pm
Location: Australia

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Andrew on Wed Feb 22, 2012 12:31 pm

I'm going to go ahead and sticky this here in the releases section as it's an important note to remember now that more and more big compilations are being released. For larger releases, we strongly encourage you to use 7-zip. You can download it here:
http://www.7-zip.org/
User avatar
Andrew
Retro Basketball Gamer
Administrator
 
Posts: 113954
Joined: Thu Aug 22, 2002 8:51 pm
Location: Australia

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Wed Feb 22, 2012 11:47 pm

same here. The next versions of the Street/APB/HiU and other mods are all going to start having more uniforms and stadiums.
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29904
Joined: Tue Sep 13, 2005 12:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby se7six on Sun Apr 01, 2012 11:31 am

I use 7-Zip with the Ultra compression settings for all of my archiving. Single files, multiple files, everything. I want all archives to be as small as possible.
Image

Image

Systems
Intel Q9550 | 4GB Corsair Dominator DDR2-1066 | 896MB BFG NVIDIA GTX 275 OCE | PC P&C Silencer Quad 750W | Vista Business SP2 x86
Intel Q9400 | 4GB Corsair DHX DDR2-800 | 896MB BFG NVIDIA GTX 260 OC2 | PC P&C Silencer EPS12V 610W | Vista Business SP2 x86

se7sixHD @ YouTube
se7six @ Moddingway

I Thessalonians 5:22 KJB
User avatar
se7six
 
Posts: 14
Joined: Sat Sep 03, 2011 11:04 pm
Location: Tennessee

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby weskerdoomz on Thu Apr 12, 2012 12:31 pm

how to use this?
Roster Update!

Click ->WeskerDoomz NBA 2K12 Roster
User avatar
weskerdoomz
 
Posts: 109
Joined: Sat Feb 04, 2012 9:41 pm

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Andrew on Thu Apr 12, 2012 7:33 pm

7-Zip works pretty much the same as WinZIP, WinRAR and the like. Select the files you want to add to an archive, create a .7z file, upload.
User avatar
Andrew
Retro Basketball Gamer
Administrator
 
Posts: 113954
Joined: Thu Aug 22, 2002 8:51 pm
Location: Australia

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby The Great White on Thu May 03, 2012 11:27 pm

Strange. I am compressing a 395mb files with an Ultra Compression level, LZMA Compression method, 64mb Dictionery size, 273 Word size, and a Solid block size but it still ends up with a compress size of 391mb.
User avatar
The Great White
 
Posts: 24
Joined: Fri Apr 13, 2012 5:23 pm

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Leftos on Thu May 03, 2012 11:56 pm

It all depends on what you are compressing. Objects that are already compressed can't be compressed further no matter how you try.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5223
Joined: Sun Jun 07, 2009 7:44 am
Location: Novato, CA, USA

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Tue May 29, 2012 6:47 am

ok...I'm a believer now.

Just compressed 2 gigs of video into 300mb, you win...
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29904
Joined: Tue Sep 13, 2005 12:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Leftos on Tue May 29, 2012 6:54 pm

Video? Seriously? AFAIK, there's nothing more efficient in compressing video than a good video codec (like x264 as we discussed). What kind of video did you compress? I'm genuinely curious here.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5223
Joined: Sun Jun 07, 2009 7:44 am
Location: Novato, CA, USA

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Wed May 30, 2012 1:20 am

Here's the GSpot info, there is a 2nd part to this first avi (lost power during a thunderstorm @ 99% rendering) but in total they are 23 minutes
You do not have the required permissions to view the files attached to this post.
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29904
Joined: Tue Sep 13, 2005 12:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Leftos on Wed May 30, 2012 2:30 am

There must be something wrong with that file. Way too much redundant information that can be compressed, because otherwise, an x264 file doesn't get any more compressed by lzma. Same way that MP3 can't be further compressed.

For one, GSpot (in your case) says there's half a GB of unneeded bytes at the end of the file. Those get compressed to none. I don't know where the other 700MB went to, but again, AFAIK, lossless compression applied on efficient lossy compression should do nothing.

I tried all X264/H264/AVC1 files I had on my hard-drive. None of them could be compressed with LZMA. Either there's something wrong with your container (the half a gig is an indication) or your encoding settings.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5223
Joined: Sun Jun 07, 2009 7:44 am
Location: Novato, CA, USA

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Wed May 30, 2012 2:51 am

here it all is
You do not have the required permissions to view the files attached to this post.
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29904
Joined: Tue Sep 13, 2005 12:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Fri Jun 08, 2012 9:28 am

something was off and wrong, I archived the wrong two videos :facepalm2:
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29904
Joined: Tue Sep 13, 2005 12:45 am
Location: 2K


Return to NBA 2K12 Modding

Who is online

Users browsing this forum: No registered users and 6 guests