encode.su
Open in
urlscan Pro
67.205.31.151
Public Scan
Submitted URL: https://encode.su/threads/550-Ultra-fast-LZ?p=53288&viewfull=1#post53288
Effective URL: https://encode.su/threads/550-Ultra-fast-LZ?p=53288&viewfull=1
Submission: On September 20 via manual from US — Scanned from DE
Effective URL: https://encode.su/threads/550-Ultra-fast-LZ?p=53288&viewfull=1
Submission: On September 20 via manual from US — Scanned from DE
Form analysis
7 forms found in the DOMPOST login.php?s=99882c13e26572f32daabda4a343f9d4&do=login
<form id="navbar_loginform" action="login.php?s=99882c13e26572f32daabda4a343f9d4&do=login" method="post" onsubmit="md5hash(vb_login_password, vb_login_md5password, vb_login_md5password_utf, 0)">
<fieldset id="logindetails" class="logindetails">
<div>
<div>
<input type="text" class="textbox default-value" name="vb_login_username" id="navbar_username" size="10" accesskey="u" tabindex="101" value="User Name">
<input type="password" class="textbox" tabindex="102" name="vb_login_password" id="navbar_password" size="10" style="display: none;">
<input type="text" class="textbox default-value" tabindex="102" name="vb_login_password_hint" id="navbar_password_hint" size="10" value="Password" style="display: inline;">
<input type="submit" class="loginbutton" tabindex="104" value="Log in" title="Enter your username and password in the boxes provided to login, or click the 'register' button to create a profile for yourself." accesskey="s">
</div>
</div>
</fieldset>
<div id="remember" class="remember">
<label for="cb_cookieuser_navbar"><input type="checkbox" name="cookieuser" value="1" id="cb_cookieuser_navbar" class="cb_cookieuser_navbar" accesskey="c" tabindex="103"> Remember Me?</label>
</div>
<input type="hidden" name="s" value="99882c13e26572f32daabda4a343f9d4">
<input type="hidden" name="securitytoken" value="guest">
<input type="hidden" name="do" value="login">
<input type="hidden" name="vb_login_md5password">
<input type="hidden" name="vb_login_md5password_utf">
</form>
POST search.php?s=99882c13e26572f32daabda4a343f9d4&do=process
<form action="search.php?s=99882c13e26572f32daabda4a343f9d4&do=process" method="post" id="navbar_search" class="navbar_search">
<input type="hidden" name="securitytoken" value="guest">
<input type="hidden" name="do" value="process">
<span class="textboxcontainer"><span><input type="text" value="" name="query" class="textbox" tabindex="99"></span></span>
<span class="buttoncontainer"><span><input type="image" class="searchbutton" src="images/buttons/search.png" name="submit" onclick="document.getElementById('navbar_search').submit;" tabindex="100"></span></span>
</form>
POST profile.php?do=dismissnotice
<form action="profile.php?do=dismissnotice" method="post" id="notices" class="notices">
<input type="hidden" name="do" value="dismissnotice">
<input type="hidden" name="s" value="s=99882c13e26572f32daabda4a343f9d4&">
<input type="hidden" name="securitytoken" value="guest">
<input type="hidden" id="dismiss_notice_hidden" name="dismiss_noticeid" value="">
<input type="hidden" name="url" value="">
<ol>
<li class="restore" id="navbar_notice_1">
<b>Welcome to the Encode's Forum!</b><br> It's probably the biggest forum about the data compression software and algorithms on the web! Here you can find state of the art compression software, detailed description on algorithms, the latest
news and, most importantly, you may ask a professional and get the answers! <a href="register.php?s=99882c13e26572f32daabda4a343f9d4&"><b>Join us</b></a> today!
</li>
</ol>
</form>
GET https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4
<form action="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" method="get" class="pagination popupmenu nohovermenu" id="yui-gen4">
<input type="hidden" name="t" value="550"><input type="hidden" name="s" value="99882c13e26572f32daabda4a343f9d4">
<span><a href="javascript://" class="popupctrl" id="yui-gen6">Page 8 of 9</a></span>
<span
class="first_last"><a rel="start" href="https://encode.su/threads/550-Ultra-fast-LZ?s=99882c13e26572f32daabda4a343f9d4" title="First Page - Results 1 to 30 of 241"><img src="images/pagination/first-right.png" alt="First" title="First">First</a></span>
<span
class="prev_next"><a rel="prev" href="https://encode.su/threads/550-Ultra-fast-LZ/page7?s=99882c13e26572f32daabda4a343f9d4" title="Prev Page - Results 181 to 210 of 241"><img src="images/pagination/previous-right.png" alt="Previous" title="Previous"></a></span>
<span class="separator">...</span>
<span><a href="https://encode.su/threads/550-Ultra-fast-LZ/page6?s=99882c13e26572f32daabda4a343f9d4" title="Show results 151 to 180 of 241">6</a></span><span><a href="https://encode.su/threads/550-Ultra-fast-LZ/page7?s=99882c13e26572f32daabda4a343f9d4" title="Show results 181 to 210 of 241">7</a></span><span
class="selected"><a href="javascript://" title="Results 211 to 240 of 241">8</a></span><span><a href="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" title="Show results 241 to 241 of 241">9</a></span>
<span
class="prev_next"><a rel="next" href="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" title="Next Page - Results 241 to 241 of 241"><img src="images/pagination/next-right.png" alt="Next" title="Next"></a></span>
<span
class="first_last"><a href="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" title="Last Page - Results 241 to 241 of 241">Last<img src="images/pagination/last-right.png" alt="Last" title="Last"></a></span>
<ul class="popupbody" id="yui-gen5">
<li class="formsubmit jumptopage"><label>Jump to page: <input type="text" name="page" size="4"></label> <input type="submit" class="button" value="Go"></li>
</ul>
</form>
POST search.php
<form action="search.php" method="post">
<ul class="popupbody" id="yui-gen9">
<li>
<input type="text" name="query" class="searchbox" value="Search..." tabindex="13">
<input type="submit" class="button" value="Search" tabindex="14">
</li>
<li class="formsubmit" id="popupsearch">
<div class="submitoptions"> </div>
<div class="advancedsearchlink"><a href="search.php?s=99882c13e26572f32daabda4a343f9d4&search_type=1&searchthreadid=550&contenttype=vBForum_Post">Advanced Search</a></div>
</li>
</ul>
<input type="hidden" name="s" value="99882c13e26572f32daabda4a343f9d4">
<input type="hidden" name="securitytoken" value="guest">
<input type="hidden" name="do" value="process">
<input type="hidden" name="searchthreadid" value="550">
<input type="hidden" name="search_type" value="1">
<input type="hidden" name="contenttype" value="vBForum_Post">
</form>
GET https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4
<form action="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" method="get" class="pagination popupmenu nohovermenu" id="yui-gen103">
<input type="hidden" name="t" value="550"><input type="hidden" name="s" value="99882c13e26572f32daabda4a343f9d4">
<span><a href="javascript://" class="popupctrl" id="yui-gen105">Page 8 of 9</a></span>
<span
class="first_last"><a rel="start" href="https://encode.su/threads/550-Ultra-fast-LZ?s=99882c13e26572f32daabda4a343f9d4" title="First Page - Results 1 to 30 of 241"><img src="images/pagination/first-right.png" alt="First" title="First">First</a></span>
<span
class="prev_next"><a rel="prev" href="https://encode.su/threads/550-Ultra-fast-LZ/page7?s=99882c13e26572f32daabda4a343f9d4" title="Prev Page - Results 181 to 210 of 241"><img src="images/pagination/previous-right.png" alt="Previous" title="Previous"></a></span>
<span class="separator">...</span>
<span><a href="https://encode.su/threads/550-Ultra-fast-LZ/page6?s=99882c13e26572f32daabda4a343f9d4" title="Show results 151 to 180 of 241">6</a></span><span><a href="https://encode.su/threads/550-Ultra-fast-LZ/page7?s=99882c13e26572f32daabda4a343f9d4" title="Show results 181 to 210 of 241">7</a></span><span
class="selected"><a href="javascript://" title="Results 211 to 240 of 241">8</a></span><span><a href="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" title="Show results 241 to 241 of 241">9</a></span>
<span
class="prev_next"><a rel="next" href="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" title="Next Page - Results 241 to 241 of 241"><img src="images/pagination/next-right.png" alt="Next" title="Next"></a></span>
<span
class="first_last"><a href="https://encode.su/threads/550-Ultra-fast-LZ/page9?s=99882c13e26572f32daabda4a343f9d4" title="Last Page - Results 241 to 241 of 241">Last<img src="images/pagination/last-right.png" alt="Last" title="Last"></a></span>
<ul class="popupbody" id="yui-gen104">
<li class="formsubmit jumptopage"><label>Jump to page: <input type="text" name="page" size="4"></label> <input type="submit" class="button" value="Go"></li>
</ul>
</form>
GET forum.php
<form action="forum.php" method="get" id="footer_select" class="footer_select">
<!-- BEGIN hide quick style chooser using a vb if conditon
<select name="styleid" onchange="switch_id(this, 'style')">
<optgroup label="Quick Style Chooser">
</optgroup>
</select>
END hide quick style chooser -->
</form>
Text Content
* Help * Remember Me? -------------------------------------------------------------------------------- * What's New? * Forum * New Posts * FAQ * Calendar * Forum Actions * Mark Forums Read * Quick Links * Today's Posts * Advanced Search * * Forum * General * Data Compression * Ultra-fast LZ -------------------------------------------------------------------------------- 1. Welcome to the Encode's Forum! It's probably the biggest forum about the data compression software and algorithms on the web! Here you can find state of the art compression software, detailed description on algorithms, the latest news and, most importantly, you may ask a professional and get the answers! Join us today! Page 8 of 9 First ... 6789 Last * Jump to page: Results 211 to 240 of 241 THREAD: ULTRA-FAST LZ * THREAD TOOLS * Show Printable Version * Email this Page… * * SEARCH THREAD * * Advanced Search * DISPLAY * Linear Mode * Switch to Hybrid Mode * Switch to Threaded Mode 1. 13th July 2017, 22:23 #211 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > The brand new ULZ v0.06 is here! > > It's byte-aligned LZ77 with a 16MB window (=block size). Now it looks > like an LZ4 with a large window. For literal run length coding I make use > of EncodeMod as described by Charles Bloom. I'm not 100% sure about the > Optimal Parsing here - currently ULZ uses some ad hoc solution for > hard-to-compress files - and looks like it does work! > > Anyway, enjoy new release! :D > > Some testing results (Intel Core i7-4790K @ 4.6GHz, 32GB @ 1866MHz DDR3 > RAM, RAMDisk) > > Code: > > Z:\>ulz c9 enwik9 > Compressing enwik9: > 1000000000 -> 291028084 in 325.732 sec > > Z:\>ulz d enwik9.ulz e9 > Decompressing enwik9.ulz: > 291028084 -> 1000000000 in 1.110 sec > > Z:\>ulz c enwik9 > Compressing enwik9: > 1000000000 -> 365851618 in 30.323 sec > > Z:\>ulz d enwik9.ulz e9 > Decompressing enwik9.ulz: > 365851618 -> 1000000000 in 1.072 sec > > Z:\>ulz c1 enwik9 > Compressing enwik9: > 1000000000 -> 421011442 in 7.379 sec > > Z:\>ulz d enwik9.ulz e9 > Decompressing enwik9.ulz: > 421011442 -> 1000000000 in 0.950 sec Attached Files * ulz006.zip (48.3 KB, 465 views) Reply With Quote -------------------------------------------------------------------------------- 2. THANKS (7): > avitar (15th July 2017),Cyan (14th July 2017),hunman (21st July > 2017),Matt Mahoney (14th July 2017),Mike (13th July > 2017),RamiroCruzo (18th July 2017),xezz (15th July 2017) -------------------------------------------------------------------------------- 3. 14th July 2017, 03:47 #212 Matt Mahoney * View Profile * View Forum Posts * Private Message * Visit Homepage Expert -------------------------------------------------------------------------------- Join Date May 2008 Location Melbourne, Florida, USA Posts 3,267 Thanks 313 Thanked 831 Times in 499 Posts > Congrats on the world's fastest decompressor. :) > http://mattmahoney.net/dc/text.html Reply With Quote -------------------------------------------------------------------------------- 4. THANKS (2): > encode (14th July 2017),Mike (14th July 2017) -------------------------------------------------------------------------------- 5. 31st August 2017, 15:01 #213 boxerab * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date May 2014 Location Canada Posts 142 Thanks 75 Thanked 21 Times in 12 Posts > Is this compressor open source, or binary only ? Reply With Quote -------------------------------------------------------------------------------- 6. 7. 31st August 2017, 17:29 #214 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Originally Posted by boxerab > Is this compressor open source, or binary only ? > At this moment, it is binary only! Reply With Quote -------------------------------------------------------------------------------- 8. THANKS: > boxerab (1st September 2017) -------------------------------------------------------------------------------- 9. 23rd March 2019, 12:39 #215 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Well, I'm about to release the ULZ as an open source (public domain) data > compression library. With minimalistic and simplest interface. The > library consists of ULZ.HPP - the library itself and ULZ.CPP - simple > demo compressor. > The usage is as simple as that: > > Code: > > int comp_len=ulz->Compress(in, in_len, out, level); > > I'm undecided about the compressor configuration. Currently I have: > 16-bit window with rep offsets (a la LZ4 competitor) > 17-bit window > 18-bit window > 18-bit window with 4 rep offsets > 19-bit window > 21-bit window with rep offsets (actual window size is limited to 2 GB) > 22-bit window with rep offsets (same unlimited window as with 21-bit > version) > 24-bit window (ULZ v0.06 modification) > > At this time I'm planning to keep the Greedy (unoptimized) parsing only, > for simplicity. Reply With Quote -------------------------------------------------------------------------------- 10. THANKS (3): > Hakan Abbas (23rd March 2019),hunman (5th April > 2021),moisesmcardona (23rd March 2019) -------------------------------------------------------------------------------- 11. 23rd March 2019, 12:43 #216 algorithm * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Apr 2015 Location Greece Posts 143 Thanks 45 Thanked 40 Times in 27 Posts > Decompressor should include out_len for buffer over run. Reply With Quote -------------------------------------------------------------------------------- 12. 13. 23rd March 2019, 12:59 #217 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > All compressed/raw size storage is up to the user. Simply write raw_len > within your stream. > and do > > Code: > > int out_len=ulz->Decompress(in, comp_len, out); Reply With Quote -------------------------------------------------------------------------------- 14. 15. 23rd March 2019, 13:05 #218 algorithm * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Apr 2015 Location Greece Posts 143 Thanks 45 Thanked 40 Times in 27 Posts > out_len should be included for malicious files that during decompression > produce larger file than specified in the format and thus cause buffer > overrun. > should be > > Code: > > size_t Decompress(in, comp_len, out, out_len) or > int Decompress(in, comp_len, out, out_len) > > Also see the LZ4 which has similar API. > Last edited by algorithm; 23rd March 2019 at 14:07. Reply With Quote -------------------------------------------------------------------------------- 16. THANKS (2): > Bulat Ziganshin (23rd March 2019),encode (23rd March 2019) -------------------------------------------------------------------------------- 17. 23rd March 2019, 14:33 #219 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Well, or at least: > > Code: > > ulz->Decompress(in, comp_len, out, BLOCK_SIZE); > > or > > ulz->Decompress<BLOCK_SIZE>(in, comp_len, out); Reply With Quote -------------------------------------------------------------------------------- 18. 19. 23rd March 2019, 18:18 #220 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Added buffer overrun protection! Reply With Quote -------------------------------------------------------------------------------- 20. 21. 24th March 2019, 11:31 #221 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Here you go: > https://compressme.net/#downloads Reply With Quote -------------------------------------------------------------------------------- 22. THANKS (9): > algorithm (24th March 2019),Bulat Ziganshin (24th March 2019),Cyan (25th > March 2019),introspec (29th March 2019),jibz (24th March 2019),Mike (24th > March 2019),moisesmcardona (24th March 2019),spark (26th March > 2019),svpv (25th March 2019) -------------------------------------------------------------------------------- 23. 24th March 2019, 12:31 #222 algorithm * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Apr 2015 Location Greece Posts 143 Thanks 45 Thanked 40 Times in 27 Posts > So ulz is similar to lz4 with 17 bits window ,3 bit run length 4 bits > match length and larger run and match lengths encoded as variable length > integers of length multiple of 7 bits. > > I think for g++ you must use ftello with _FILE_OFFSET_BITS defined as 64. Reply With Quote -------------------------------------------------------------------------------- 24. THANKS: > encode (24th March 2019) -------------------------------------------------------------------------------- 25. 24th March 2019, 13:09 #223 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Thanks! Added g++ support. > And yep, you are correct about the ULZ algorithm description. Reply With Quote -------------------------------------------------------------------------------- 26. 27. 24th March 2019, 16:01 #224 moisesmcardona * View Profile * View Forum Posts * Private Message * Visit Homepage Member -------------------------------------------------------------------------------- Join Date Jun 2009 Location Puerto Rico Posts 286 Thanks 177 Thanked 72 Times in 53 Posts > A recommendation, for binary files it's best to use the Release section > ;) Reply With Quote -------------------------------------------------------------------------------- 28. THANKS: > encode (24th March 2019) -------------------------------------------------------------------------------- 29. 25th March 2019, 02:29 #225 Shelwien * View Profile * View Forum Posts * Private Message * Visit Homepage Administrator -------------------------------------------------------------------------------- Join Date May 2008 Location Kharkov, Ukraine Posts 4,905 Thanks 432 Thanked 1,983 Times in 1,147 Posts > 7820X @ 4.5Ghz, ramdisk > > Code: > > 5.188s 1.000s: ulz_ic19_SSE2-O1-ipo.exe c1 enwik9 x & ulz_ic19_SSE2-O1-ipo.exe d x y > 5.219s 1.016s: ulz_ic19_SSE2-O3-ipo-PGO.exe c1 enwik9 x & ulz_ic19_SSE2-O3-ipo-PGO.exe d x y > 5.313s 1.015s: ulz_VS2017.exe c1 enwik9 x & ulz_VS2017.exe d x y > 5.328s 1.015s: ulz_clang9_k8.exe c1 enwik9 x & ulz_clang9_k8.exe d x y > 5.375s 1.015s: ulz_ic19_SSE2-O3-ipo.exe c1 enwik9 x & ulz_ic19_SSE2-O3-ipo.exe d x y > 5.391s 1.015s: ulz_ic19_SSE2-O3.exe c1 enwik9 x & ulz_ic19_SSE2-O3.exe d x y > 5.391s 1.032s: ulz_gcc82_k8.exe c1 enwik9 x & ulz_gcc82_k8.exe d x y > 5.406s 1.015s: ulz_ic19_SSE2-O2-ipo.exe c1 enwik9 x & ulz_ic19_SSE2-O2-ipo.exe d x y > 5.453s 1.032s: ulz_gcc82_k8-lto.exe c1 enwik9 x & ulz_gcc82_k8-lto.exe d x y Reply With Quote -------------------------------------------------------------------------------- 30. THANKS (4): > encode (25th March 2019),Mike (25th March 2019),moisesmcardona (25th > March 2019),spark (26th March 2019) -------------------------------------------------------------------------------- 31. 29th March 2019, 22:05 #226 dnd * View Profile * View Forum Posts * Private Message * Visit Homepage Member -------------------------------------------------------------------------------- Join Date Mar 2013 Location Worldwide Posts 751 Thanks 97 Thanked 300 Times in 215 Posts > ULZ added into Turbobench Compression Benchmark > Homepage - Twitter - Github Reply With Quote -------------------------------------------------------------------------------- 32. THANKS: > encode (29th March 2019) -------------------------------------------------------------------------------- 33. 3rd April 2019, 14:03 #227 FatBit * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Jan 2012 Location Prague, CZ Posts 195 Thanks 0 Thanked 36 Times in 27 Posts ULZ TEST > Dear colleagues, > > I woud like to share my results for tar file compression (tarred files > from my benchmark for FileOptimizer) on "average" pc. > > Best regards, > > FatBit Attached Thumbnails Reply With Quote -------------------------------------------------------------------------------- 34. THANKS: > encode (3rd April 2019) -------------------------------------------------------------------------------- 35. 6th April 2019, 23:22 #228 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Some testing results of the ULZ with Optimal Parsing + modifications: > > No code has to be inserted here. Reply With Quote -------------------------------------------------------------------------------- 36. 37. 14th April 2019, 22:40 #229 jibz * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Jan 2015 Location Denmark Posts 129 Thanks 117 Thanked 75 Times in 54 Posts > Originally Posted by encode > Added buffer overrun protection! > Btw, I found a couple of places where bad input could still result in a > buffer overrun, I opened a pull request with some fixes on the GitHub > page. Reply With Quote -------------------------------------------------------------------------------- 38. THANKS: > encode (15th April 2019) -------------------------------------------------------------------------------- 39. 15th April 2019, 00:19 #230 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Thanks a bunch! Already added these fixes to the upcoming release! > In addition, I've already added a Fast compression mode (CompressFast()) > Completed the CompressOptimal() (but it will be not included in the > upcoming release) > My main concern for now is the Normal mode. > Hash chains are good, but 2-byte lookahead in v1.00 is too slow. > Double hash chains / my MMC implementation failed here - too much time > spent on pointer setup. > Binary tree with partial updates my main thing for experiments for now... Reply With Quote -------------------------------------------------------------------------------- 40. THANKS (2): > avitar (15th April 2019),jibz (15th April 2019) -------------------------------------------------------------------------------- 41. 19th April 2019, 10:53 #231 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > ULZ v1.01 BETA has been released: > https://compressme.net/#downloads > > + New fast compression mode (c1, default) > + Safer decompressor > + Reconfigured compression levels: > > 1 - CompressFast(), HashTable-based match finder > 2..4 - Compress(), Hash chains, Greedy parsing > 5..9 - Compress(), Hash chains, Non-greedy 1-byte lookahead Reply With Quote -------------------------------------------------------------------------------- 42. THANKS (5): > avitar (23rd April 2019),Bulat Ziganshin (22nd April 2019),comp1 (19th > April 2019),jibz (20th April 2019),Mike (19th April 2019) -------------------------------------------------------------------------------- 43. 22nd April 2019, 17:39 #232 smjohn1 * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Feb 2016 Location USA Posts 104 Thanks 41 Thanked 8 Times in 8 Posts > What is the O bit? Reply With Quote -------------------------------------------------------------------------------- 44. 45. 22nd April 2019, 17:53 #233 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Originally Posted by smjohn1 > What is the O bit? > Higher bits of an Offset (Match Distance) Reply With Quote -------------------------------------------------------------------------------- 46. 47. 22nd April 2019, 21:12 #234 smjohn1 * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Feb 2016 Location USA Posts 104 Thanks 41 Thanked 8 Times in 8 Posts > OK, thanks. > > Originally Posted by encode > Higher bits of an Offset (Match Distance) Reply With Quote -------------------------------------------------------------------------------- 48. 49. 28th April 2019, 19:22 #235 FatBit * View Profile * View Forum Posts * Private Message Member -------------------------------------------------------------------------------- Join Date Jan 2012 Location Prague, CZ Posts 195 Thanks 0 Thanked 36 Times in 27 Posts ULZ TIMING UPDATE > Best regards, > > FatBit Attached Thumbnails Reply With Quote -------------------------------------------------------------------------------- 50. THANKS: > encode (28th April 2019) -------------------------------------------------------------------------------- 51. 28th April 2019, 22:12 #236 Sportman * View Profile * View Forum Posts * Private Message * Visit Homepage Member -------------------------------------------------------------------------------- Join Date Aug 2008 Location Planet Earth Posts 1,436 Thanks 211 Thanked 715 Times in 480 Posts > ULZ v1.01 BETA: > > Input: > enwik9 > > Output: > 460,463,054 bytes, 3.158 sec. - 0.742 sec., c1 > 409,136,504 bytes, 5.848 sec. - 0.757 sec., c2 > 393,640,476 bytes, 7.711 sec. - 0.721 sec., c3 > 383,318,792 bytes, 10.716 sec. - 0.719 sec., c4 > 363,151,876 bytes, 23.298 sec. - 0.768 sec., c5 > 359,939,352 bytes, 31.166 sec. - 0.766 sec., c6 > 358,155,488 bytes, 39.326 sec. - 0.786 sec., c7 > 357,230,196 bytes, 47.285 sec. - 0.763 sec., c8 > 356,494,682 bytes, 65.747 sec. - 0.763 sec., c9 Reply With Quote -------------------------------------------------------------------------------- 52. THANKS: > encode (28th April 2019) -------------------------------------------------------------------------------- 53. 28th April 2019, 22:38 #237 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > @Sportman > System specs? Reply With Quote -------------------------------------------------------------------------------- 54. 55. 28th April 2019, 23:18 #238 Sportman * View Profile * View Forum Posts * Private Message * Visit Homepage Member -------------------------------------------------------------------------------- Join Date Aug 2008 Location Planet Earth Posts 1,436 Thanks 211 Thanked 715 Times in 480 Posts > Originally Posted by encode > System specs? > Z370 > i9-9900K at 5.3GHz (16MB cache) > 32GB DDR4 4266MHz Reply With Quote -------------------------------------------------------------------------------- 56. THANKS: > encode (29th April 2019) -------------------------------------------------------------------------------- 57. 29th April 2019, 00:36 #239 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Thanks! Traditionally and through the years, you have a very nice PC > specs! Reply With Quote -------------------------------------------------------------------------------- 58. 59. 14th March 2021, 11:37 #240 encode * View Profile * View Forum Posts * Private Message * Visit Homepage The Founder -------------------------------------------------------------------------------- Join Date May 2006 Location Moscow, Russia Posts 4,119 Thanks 573 Thanked 519 Times in 199 Posts > Check out a new BETA version made to test some new ideas! > It's still a byte aligned LZ77, window size is 64 KB. Attached Files * ulz102BETA.zip (61.4 KB, 127 views) Reply With Quote -------------------------------------------------------------------------------- 60. THANKS (4): > comp1 (17th March 2021),danlock (16th March 2021),kimstik (4th May > 2023),Mike (14th March 2021) -------------------------------------------------------------------------------- Page 8 of 9 First ... 6789 Last * Jump to page: « Previous Thread | Next Thread » TAGS FOR THIS THREAD lz, lz77, ultra-fast lz, ulz View Tag Cloud POSTING PERMISSIONS * You may not post new threads * You may not post replies * You may not post attachments * You may not edit your posts * * BB code is On * Smilies are On * [IMG] code is On * [VIDEO] code is On * HTML code is Off Forum Rules * CompressMe.net All times are GMT +3. The time now is 00:21. Powered by vBulletin; Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.