Buffer protocol types
What is the Python 'buffer' type for? - Stack Overflow
Accept `ReadableBuffer` instead of `bytes` in `base64` encode functions?
python - How do I add a type hint for a WriteableBuffer parameter? - Stack Overflow
An example usage:
>>> s = 'Hello world'
>>> t = buffer(s, 6, 5)
>>> t
<read-only buffer for 0x10064a4b0, size 5, offset 6 at 0x100634ab0>
>>> print t
world
The buffer in this case is a sub-string, starting at position 6 with length 5, and it doesn't take extra storage space - it references a slice of the string.
This isn't very useful for short strings like this, but it can be necessary when using large amounts of data. This example uses a mutable bytearray:
>>> s = bytearray(1000000) # a million zeroed bytes
>>> t = buffer(s, 1) # slice cuts off the first byte
>>> s[1] = 5 # set the second element in s
>>> t[0] # which is now also the first element in t!
'\x05'
This can be very helpful if you want to have more than one view on the data and don't want to (or can't) hold multiple copies in memory.
Note that buffer has been replaced by the better named memoryview in Python 3, though you can use either in Python 2.7.
Note also that you can't implement a buffer interface for your own objects without delving into the C API, i.e. you can't do it in pure Python.
I think buffers are e.g. useful when interfacing Python to native libraries (Guido van Rossum explains buffer in this mailing list post).
For example, NumPy seems to use buffer for efficient data storage:
import numpy
a = numpy.ndarray(1000000)
The a.data is a:
<read-write buffer for 0x1d7b410, size 8000000, offset 0 at 0x1e353b0>
Starting with Python 3.12, collections.abc.Buffer can be used like so:
from collections.abc import Buffer
def foo(buffer: Buffer):
pass
Currently (as of Python 3.6) the "Buffer Protocol" is a C API thing only - you can't even talk about it in regular Python code.
cf: Add typing.py class describing a PEP 3118 buffer object
I would use Any for now.