pypi.org Open in urlscan Pro
2a04:4e42::223  Public Scan

Form analysis
3 forms found in the DOM

/search/

<form class="search-form search-form--primary" action="/search/" role="search">
  <label for="search" class="sr-only">Search PyPI</label>
  <input id="search" class="search-form__search" type="text" name="q" placeholder="Search projects" value="" autocomplete="off" autocapitalize="off" spellcheck="false" data-controller="search-focus"
    data-action="keydown@window->search-focus#focusSearchField" data-search-focus-target="searchField">
  <button type="submit" class="search-form__button">
    <i class="fa fa-search" aria-hidden="true"></i>
    <span class="sr-only">Search</span>
  </button>
</form>

/search/

<form class="search-form search-form--fullwidth" action="/search/" role="search">
  <label for="mobile-search" class="sr-only">Search PyPI</label>
  <input id="mobile-search" class="search-form__search" type="text" name="q" placeholder="Search projects" value="" autocomplete="off" autocapitalize="off" spellcheck="false">
  <button type="submit" class="search-form__button">
    <i class="fa fa-search" aria-hidden="true"></i>
    <span class="sr-only">Search</span>
  </button>
</form>

/locale/

<form action="/locale/">
  <ul>
    <li>
      <button class="language-switcher__selected" name="locale_id" value="en" type="submit"> English </button>
    </li>
    <li>
      <button name="locale_id" value="es" type="submit"> español </button>
    </li>
    <li>
      <button name="locale_id" value="fr" type="submit"> français </button>
    </li>
    <li>
      <button name="locale_id" value="ja" type="submit"> 日本語 </button>
    </li>
    <li>
      <button name="locale_id" value="pt_BR" type="submit"> português (Brasil) </button>
    </li>
    <li>
      <button name="locale_id" value="uk" type="submit"> українська </button>
    </li>
    <li>
      <button name="locale_id" value="el" type="submit"> Ελληνικά </button>
    </li>
    <li>
      <button name="locale_id" value="de" type="submit"> Deutsch </button>
    </li>
    <li>
      <button name="locale_id" value="zh_Hans" type="submit"> 中文 (简体) </button>
    </li>
    <li>
      <button name="locale_id" value="zh_Hant" type="submit"> 中文 (繁體) </button>
    </li>
    <li>
      <button name="locale_id" value="ru" type="submit"> русский </button>
    </li>
    <li>
      <button name="locale_id" value="he" type="submit"> עברית </button>
    </li>
    <li>
      <button name="locale_id" value="eo" type="submit"> Esperanto </button>
    </li>
  </ul>
</form>

Text Content

Skip to main content Switch to mobile version
Warning Some features may not work without JavaScript. Please try enabling it if
you encounter problems.
Join the official Python Developers Survey 2024 and have a chance to win a
prize!  Take the 2024 survey


Search PyPI Search
 * Help
 * Sponsors
 * Log in
 * Register

Menu
 * Help
 * Sponsors
 * Log in
 * Register

Search PyPI Search


BITSANDBYTES 0.44.1

pip install bitsandbytes Copy PIP instructions

Latest version

Released: Sep 30, 2024

k-bit optimizers and matrix multiplication routines.




NAVIGATION

 * Project description
 * Release history
 * Download files


VERIFIED DETAILS

These details have been verified by PyPI

MAINTAINERS

timdettmers Titus-von-Koeller


UNVERIFIED DETAILS

These details have not been verified by PyPI

PROJECT LINKS

 * Homepage

META

 * License: MIT
 * Author: Tim Dettmers
 * Tags gpu, optimizers, optimization, 8-bit, quantization, compression
 * Provides-Extra: benchmark, test

CLASSIFIERS

 * Development Status
   * 4 - Beta
 * Topic
   * Scientific/Engineering :: Artificial Intelligence

JetBrains is a Contributing sponsor of the Python Software Foundation.
PSF Sponsor · Served ethically

 * Project description
 * Project details
 * Release history
 * Download files


PROJECT DESCRIPTION


BITSANDBYTES



The bitsandbytes library is a lightweight Python wrapper around CUDA custom
functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()),
and 8 & 4-bit quantization functions.

The library includes quantization primitives for 8-bit & 4-bit operations,
through bitsandbytes.nn.Linear8bitLt and bitsandbytes.nn.Linear4bit and 8-bit
optimizers through bitsandbytes.optim module.

There are ongoing efforts to support further hardware backends, i.e. Intel CPU +
GPU, AMD GPU, Apple Silicon. Windows support is quite far along and is on its
way as well.

Please head to the official documentation page:

https://huggingface.co/docs/bitsandbytes/main


ALPHA TESTERS WANTED: MULTI-BACKEND-REFACTOR AMD GPU + INTEL CPU/GPU SPECIFIC
BNB BACKEND IMPLEMENTATIONS

We're in the process of a complex refactor in order to allow the support of
additional hardware backends, other than CUDA, in BNB. The efforts around this
are already quite far along and there's plenty of functionality already in place
that is in need for users to take a hands-on approach! Mac support will likely
soon also see progress. However, I recommend waiting 2 weeks until the device
abstraction has further consolidated (breaking changes upcoming).

Currently, you still need to compile from source, after checking out the
multi-backend-refactor branch (instructions WIP, but the current docs on the
compilation from source are a good starting point; feel free to share tips /
input in this Github discussion. We'll soon enable nightly releases to make this
much easier for you!

Please give feedback to us in this dedicated Github Discussion space!

We're super excited about these recent developments and grateful for any
constructive input or support that you can give to help us make this a reality.
BNB is a community project and we're excited for your collaboration 🤗


LICENSE

bitsandbytes is MIT licensed.

We thank Fabio Cannizzo for his work on FastBinarySearch which we use for CPU
quantization.


PROJECT DETAILS


VERIFIED DETAILS

These details have been verified by PyPI

MAINTAINERS

timdettmers Titus-von-Koeller


UNVERIFIED DETAILS

These details have not been verified by PyPI

PROJECT LINKS

 * Homepage

META

 * License: MIT
 * Author: Tim Dettmers
 * Tags gpu, optimizers, optimization, 8-bit, quantization, compression
 * Provides-Extra: benchmark, test

CLASSIFIERS

 * Development Status
   * 4 - Beta
 * Topic
   * Scientific/Engineering :: Artificial Intelligence



RELEASE HISTORY RELEASE NOTIFICATIONS | RSS FEED

This version


0.44.1

Sep 30, 2024

0.44.0

Sep 23, 2024

0.44.0rc1 pre-release

Sep 23, 2024

0.43.3

Jul 30, 2024

0.43.2

Jul 23, 2024

0.43.1

Apr 11, 2024

0.43.0

Mar 7, 2024

0.42.0

Jan 7, 2024

0.41.3.post2

Dec 11, 2023

0.41.3.post1

Dec 11, 2023

0.41.3

Dec 6, 2023

0.41.2.post2

Nov 8, 2023

0.41.2.post1

Nov 8, 2023

0.41.2

Nov 7, 2023

0.41.1

Aug 3, 2023

0.41.0

Jul 22, 2023

0.40.2

Jul 16, 2023

0.40.1.post1

Jul 14, 2023

0.40.1

Jul 14, 2023

0.40.0.post4

Jul 11, 2023

0.40.0.post3

Jul 11, 2023

0.40.0.post2

Jul 10, 2023

0.40.0.post1

Jul 10, 2023

0.40.0

Jul 10, 2023

0.39.1

Jun 19, 2023

0.39.0

May 23, 2023

0.38.1

Apr 12, 2023

0.38.0.post2

Apr 12, 2023

0.38.0.post1

Apr 11, 2023

0.38.0

Apr 11, 2023

0.37.2

Mar 21, 2023

0.37.1

Mar 12, 2023

0.37.0

Feb 1, 2023

0.36.0.post2

Jan 4, 2023

0.36.0.post1

Jan 4, 2023

0.36.0

Jan 4, 2023

0.35.4

Oct 31, 2022

0.35.3

Oct 27, 2022

0.35.2

Oct 27, 2022

0.35.1

Oct 25, 2022

0.35.0

Oct 9, 2022

0.34.0

Sep 19, 2022

0.33.1

Sep 14, 2022

0.33.0

Sep 11, 2022

0.32.3

Sep 8, 2022

0.32.2

Aug 23, 2022

0.32.1

Aug 17, 2022

0.32.0

Aug 16, 2022

0.31.8

Aug 8, 2022


DOWNLOAD FILES

Download the file for your platform. If you're not sure which to choose, learn
more about installing packages.


SOURCE DISTRIBUTIONS

No source distribution files available for this release.See tutorial on
generating distribution archives.


BUILT DISTRIBUTIONS

bitsandbytes-0.44.1-py3-none-win_amd64.whl (121.5 MB view hashes)

Uploaded Sep 30, 2024 Python 3 Windows x86-64

bitsandbytes-0.44.1-py3-none-manylinux_2_24_x86_64.whl (122.4 MB view hashes)

Uploaded Sep 30, 2024 Python 3 manylinux: glibc 2.24+ x86-64

Close


HASHES FOR BITSANDBYTES-0.44.1-PY3-NONE-WIN_AMD64.WHL

Hashes for bitsandbytes-0.44.1-py3-none-win_amd64.whl Algorithm Hash digest
SHA256 8e68e12aa25d2cf9a1730ad72890a5d1a19daa23f459a6a4679331f353d58cb4 Copy MD5
a1911fb9d314b58e86a5374fb4e6c261 Copy BLAKE2b-256
5ff511bddebb5addc0a005b0c1cecc6e4c6e4055ad7b860bdcbf6374e12a51f5 Copy

Close
Close


HASHES FOR BITSANDBYTES-0.44.1-PY3-NONE-MANYLINUX_2_24_X86_64.WHL

Hashes for bitsandbytes-0.44.1-py3-none-manylinux_2_24_x86_64.whl Algorithm Hash
digest SHA256 b2f24c6cbf11fc8c5d69b3dcecee9f7011451ec59d6ac833e873c9f105259668
Copy MD5 f5dad30e76c52f93b730b707288d9f82 Copy BLAKE2b-256
e4e6ccb84da7ffaf208a71c2c3c8e1120b34759df640db959660be9a98505eb4 Copy

Close


HELP

 * Installing packages
 * Uploading packages
 * User guide
 * Project name retention
 * FAQs


ABOUT PYPI

 * PyPI Blog
 * Infrastructure dashboard
 * Statistics
 * Logos & trademarks
 * Our sponsors


CONTRIBUTING TO PYPI

 * Bugs and feedback
 * Contribute on GitHub
 * Translate PyPI
 * Sponsor PyPI
 * Development credits


USING PYPI

 * Code of conduct
 * Report security issue
 * Privacy Notice
 * Terms of Use
 * Acceptable Use Policy

--------------------------------------------------------------------------------

Status: All Systems Operational

Developed and maintained by the Python community, for the Python community.
Donate today!

"PyPI", "Python Package Index", and the blocks logos are registered trademarks
of the Python Software Foundation.


© 2024 Python Software Foundation
Site map

Switch to desktop version
 * English
 * español
 * français
 * 日本語
 * português (Brasil)
 * українська
 * Ελληνικά
 * Deutsch
 * 中文 (简体)
 * 中文 (繁體)
 * русский
 * עברית
 * Esperanto

Supported by


AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google
Download Analytics Microsoft PSF Sponsor Pingdom Monitoring Sentry Error logging
StatusPage Status page