For Large Files: Quick Note about Compression (RAR vs LZMA)

A hub for everything related to NBA 2K12 modding. Releases, previews, requests, and other modding discussion belongs here.

For Large Files: Quick Note about Compression (RAR vs LZMA)

Postby Leftos on Sat Jan 07, 2012 7:49 am

Just a quick note to all modders, especially those who make big update packs, regarding the comparison of compression algorithms.

Single Jersey
Uncompressed: 3.97MB
RAR (best profile): 1.06MB
LZMA (maximum profile): 0.93MB (12% better)

5 Jerseys
Uncompressed: 19.6MB
RAR (best profile, solid): 4.64MB
LZMA (maximum profile, solid): 3.25MB (30% better)

30 Teams, 75 Jerseys
Uncompressed: 294MB
RAR (best profile, solid): 68.5MB
LZMA (maximum profile, solid): 35.8MB (48% better)

So, obvious result, LZMA offers much better compression on those uncompressed IFF files, offering almost half the filesize on a big 30-team jersey update pack. You'll save both your and your end user's bandwidth, by switching to 7-zip, and thus, LZMA.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5285
Joined: Sun Jun 07, 2009 8:44 am
Location: Novato, CA, USA

Re: Quick Note about Compression (RAR vs LZMA)

Postby Andrew on Sat Jan 07, 2012 10:47 am

Good to know, thanks for the comparison. :)
NLSC Webmaster/Administrator
Image
Contact: Email | Twitter
Release Topics: NBA Live 08 | NBA Live 07 | NBA Live 06 | NBA Live 2005 | NBA Live 2004
Story Topics: NBA 2K19 | NBA 2K13 | NBA Live 06 (Part 2) | NBA Live 06 (HOF) | NBA Live 2004 (HOF)
NLSC: Podcast | The Friday Five | Monday Tip-Off | Wayback Wednesday | 25th Anniversary of NBA Live | Facebook | Twitter | YouTube


Support The NLSC Hosting Fund: Patreon | GoFundMe

Image
Like my work? Want to help out with the NLSC Hosting Fund? Please consider leaving a tip!
User avatar
Andrew
Year 20
Administrator
 
Posts: 111153
Joined: Thu Aug 22, 2002 9:51 pm
Location: Australia

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Andrew on Wed Feb 22, 2012 1:31 pm

I'm going to go ahead and sticky this here in the releases section as it's an important note to remember now that more and more big compilations are being released. For larger releases, we strongly encourage you to use 7-zip. You can download it here:
http://www.7-zip.org/
NLSC Webmaster/Administrator
Image
Contact: Email | Twitter
Release Topics: NBA Live 08 | NBA Live 07 | NBA Live 06 | NBA Live 2005 | NBA Live 2004
Story Topics: NBA 2K19 | NBA 2K13 | NBA Live 06 (Part 2) | NBA Live 06 (HOF) | NBA Live 2004 (HOF)
NLSC: Podcast | The Friday Five | Monday Tip-Off | Wayback Wednesday | 25th Anniversary of NBA Live | Facebook | Twitter | YouTube


Support The NLSC Hosting Fund: Patreon | GoFundMe

Image
Like my work? Want to help out with the NLSC Hosting Fund? Please consider leaving a tip!
User avatar
Andrew
Year 20
Administrator
 
Posts: 111153
Joined: Thu Aug 22, 2002 9:51 pm
Location: Australia

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby HAWK23 on Wed Feb 22, 2012 5:49 pm

Will be using 7-zip from now on!
UBR Online: http://www.UltimateNBA2k.comTwitter: @UltimateNBA2KFacebook: https://www.facebook.com/UltimateNBA2K

:arrow:Download the Ultimate Base Roster for NBA 2K12
:arrow:Download the Ultimate Base Roster for NBA 2K14



2021 Mod2020 Mod
2019 Mod2018 Mod2017 Mod2016 Mod2015 Mod2014 Mod2013 Mod2012 Mod2011 Mod2010 Mod
2009 Mod2008 Mod2007 Mod2006 Mod2005 Mod2004 Mod2003 Mod2002 Mod2001 Mod2000 Mod
1999 Mod1998 Mod1997 Mod1996 Mod1995 Mod1994 Mod1993 Mod1992 Mod1991 Mod1990 Mod
1989 Mod1988 Mod1987 Mod1986 Mod1985 Mod1984 Mod1983 Mod1982 Mod1981 Mod1980 Mod
1979 Mod1978 Mod1977 Mod1976 Mod1975 Mod1974 Mod1973 Mod1972 Mod1971 Mod1970 Mod
1969 Mod1968 Mod1967 Mod1966 Mod1965 Mod1964 Mod1963 Mod1962 Mod1961 Mod1960 Mod
1959 Mod1958 Mod1957 Mod1956 Mod1955 Mod1952 Mod
Ultimate 00's RosterUltimate 90's RosterUltimate 80's RosterUltimate 70's RosterUltimate 60's Roster
All-Time Legends RosterAll-Time Champions Roster All-Star/USA Roster All-Time Fantasy Draft Roster
User avatar
HAWK23
Contributor
Contributor
 
Posts: 5628
Joined: Fri Dec 27, 2002 5:06 am
Location: Chicago

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Thu Feb 23, 2012 12:47 am

same here. The next versions of the Street/APB/HiU and other mods are all going to start having more uniforms and stadiums.
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29983
Joined: Tue Sep 13, 2005 1:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby se7six on Sun Apr 01, 2012 12:31 pm

I use 7-Zip with the Ultra compression settings for all of my archiving. Single files, multiple files, everything. I want all archives to be as small as possible.
Image

Image

Systems
Intel Q9550 | 4GB Corsair Dominator DDR2-1066 | 896MB BFG NVIDIA GTX 275 OCE | PC P&C Silencer Quad 750W | Vista Business SP2 x86
Intel Q9400 | 4GB Corsair DHX DDR2-800 | 896MB BFG NVIDIA GTX 260 OC2 | PC P&C Silencer EPS12V 610W | Vista Business SP2 x86

se7sixHD @ YouTube
se7six @ Moddingway

I Thessalonians 5:22 KJB
User avatar
se7six
 
Posts: 14
Joined: Sun Sep 04, 2011 12:04 am
Location: Tennessee

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby weskerdoomz on Thu Apr 12, 2012 1:31 pm

how to use this?
Roster Update!

Click ->WeskerDoomz NBA 2K12 Roster
User avatar
weskerdoomz
 
Posts: 110
Joined: Sat Feb 04, 2012 10:41 pm

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Andrew on Thu Apr 12, 2012 8:33 pm

7-Zip works pretty much the same as WinZIP, WinRAR and the like. Select the files you want to add to an archive, create a .7z file, upload.
NLSC Webmaster/Administrator
Image
Contact: Email | Twitter
Release Topics: NBA Live 08 | NBA Live 07 | NBA Live 06 | NBA Live 2005 | NBA Live 2004
Story Topics: NBA 2K19 | NBA 2K13 | NBA Live 06 (Part 2) | NBA Live 06 (HOF) | NBA Live 2004 (HOF)
NLSC: Podcast | The Friday Five | Monday Tip-Off | Wayback Wednesday | 25th Anniversary of NBA Live | Facebook | Twitter | YouTube


Support The NLSC Hosting Fund: Patreon | GoFundMe

Image
Like my work? Want to help out with the NLSC Hosting Fund? Please consider leaving a tip!
User avatar
Andrew
Year 20
Administrator
 
Posts: 111153
Joined: Thu Aug 22, 2002 9:51 pm
Location: Australia

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby The Great White on Fri May 04, 2012 12:27 am

Strange. I am compressing a 395mb files with an Ultra Compression level, LZMA Compression method, 64mb Dictionery size, 273 Word size, and a Solid block size but it still ends up with a compress size of 391mb.
User avatar
The Great White
 
Posts: 24
Joined: Fri Apr 13, 2012 6:23 pm

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Leftos on Fri May 04, 2012 12:56 am

It all depends on what you are compressing. Objects that are already compressed can't be compressed further no matter how you try.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5285
Joined: Sun Jun 07, 2009 8:44 am
Location: Novato, CA, USA

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Tue May 29, 2012 7:47 am

ok...I'm a believer now.

Just compressed 2 gigs of video into 300mb, you win...
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29983
Joined: Tue Sep 13, 2005 1:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Leftos on Tue May 29, 2012 7:54 pm

Video? Seriously? AFAIK, there's nothing more efficient in compressing video than a good video codec (like x264 as we discussed). What kind of video did you compress? I'm genuinely curious here.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5285
Joined: Sun Jun 07, 2009 8:44 am
Location: Novato, CA, USA

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Wed May 30, 2012 2:20 am

Here's the GSpot info, there is a 2nd part to this first avi (lost power during a thunderstorm @ 99% rendering) but in total they are 23 minutes
You do not have the required permissions to view the files attached to this post.
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29983
Joined: Tue Sep 13, 2005 1:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby Leftos on Wed May 30, 2012 3:30 am

There must be something wrong with that file. Way too much redundant information that can be compressed, because otherwise, an x264 file doesn't get any more compressed by lzma. Same way that MP3 can't be further compressed.

For one, GSpot (in your case) says there's half a GB of unneeded bytes at the end of the file. Those get compressed to none. I don't know where the other 700MB went to, but again, AFAIK, lossless compression applied on efficient lossy compression should do nothing.

I tried all X264/H264/AVC1 files I had on my hard-drive. None of them could be compressed with LZMA. Either there's something wrong with your container (the half a gig is an indication) or your encoding settings.
Eleftherios "Leftos" Aslanoglou
NBA 2K AI Software Engineer
Visual Concepts Entertainment / 2K Sports

Used to be "That Tools Guy" around here during the good ol' days. Although you probably remember me as your favorite Podcast host.
User avatar
Leftos
I'm The Pipeline, The Pipeline Is Me
NBA 2K Developer
 
Posts: 5285
Joined: Sun Jun 07, 2009 8:44 am
Location: Novato, CA, USA

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Wed May 30, 2012 3:51 am

here it all is
You do not have the required permissions to view the files attached to this post.
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29983
Joined: Tue Sep 13, 2005 1:45 am
Location: 2K

Re: For Large Files: Quick Note about Compression (RAR vs LZ

Postby JaoSming on Fri Jun 08, 2012 10:28 am

something was off and wrong, I archived the wrong two videos :facepalm2:
Opinions are my own.

JaoSming
2KTV Producer
NBA 2K Developer
 
Posts: 29983
Joined: Tue Sep 13, 2005 1:45 am
Location: 2K


Return to NBA 2K12 Modding

Who is online

Users browsing this forum: No registered users and 11 guests