Home | History | Annotate | Download | only in c-api
      1 .. highlightlang:: c
      2 
      3 .. _supporting-cycle-detection:
      4 
      5 Supporting Cyclic Garbage Collection
      6 ====================================
      7 
      8 Python's support for detecting and collecting garbage which involves circular
      9 references requires support from object types which are "containers" for other
     10 objects which may also be containers.  Types which do not store references to
     11 other objects, or which only store references to atomic types (such as numbers
     12 or strings), do not need to provide any explicit support for garbage
     13 collection.
     14 
     15 To create a container type, the :c:member:`~PyTypeObject.tp_flags` field of the type object must
     16 include the :const:`Py_TPFLAGS_HAVE_GC` and provide an implementation of the
     17 :c:member:`~PyTypeObject.tp_traverse` handler.  If instances of the type are mutable, a
     18 :c:member:`~PyTypeObject.tp_clear` implementation must also be provided.
     19 
     20 
     21 .. data:: Py_TPFLAGS_HAVE_GC
     22    :noindex:
     23 
     24    Objects with a type with this flag set must conform with the rules
     25    documented here.  For convenience these objects will be referred to as
     26    container objects.
     27 
     28 Constructors for container types must conform to two rules:
     29 
     30 #. The memory for the object must be allocated using :c:func:`PyObject_GC_New`
     31    or :c:func:`PyObject_GC_NewVar`.
     32 
     33 #. Once all the fields which may contain references to other containers are
     34    initialized, it must call :c:func:`PyObject_GC_Track`.
     35 
     36 
     37 .. c:function:: TYPE* PyObject_GC_New(TYPE, PyTypeObject *type)
     38 
     39    Analogous to :c:func:`PyObject_New` but for container objects with the
     40    :const:`Py_TPFLAGS_HAVE_GC` flag set.
     41 
     42 
     43 .. c:function:: TYPE* PyObject_GC_NewVar(TYPE, PyTypeObject *type, Py_ssize_t size)
     44 
     45    Analogous to :c:func:`PyObject_NewVar` but for container objects with the
     46    :const:`Py_TPFLAGS_HAVE_GC` flag set.
     47 
     48 
     49 .. c:function:: TYPE* PyObject_GC_Resize(TYPE, PyVarObject *op, Py_ssize_t newsize)
     50 
     51    Resize an object allocated by :c:func:`PyObject_NewVar`.  Returns the
     52    resized object or *NULL* on failure.
     53 
     54 
     55 .. c:function:: void PyObject_GC_Track(PyObject *op)
     56 
     57    Adds the object *op* to the set of container objects tracked by the
     58    collector.  The collector can run at unexpected times so objects must be
     59    valid while being tracked.  This should be called once all the fields
     60    followed by the :c:member:`~PyTypeObject.tp_traverse` handler become valid, usually near the
     61    end of the constructor.
     62 
     63 
     64 .. c:function:: void _PyObject_GC_TRACK(PyObject *op)
     65 
     66    A macro version of :c:func:`PyObject_GC_Track`.  It should not be used for
     67    extension modules.
     68 
     69 Similarly, the deallocator for the object must conform to a similar pair of
     70 rules:
     71 
     72 #. Before fields which refer to other containers are invalidated,
     73    :c:func:`PyObject_GC_UnTrack` must be called.
     74 
     75 #. The object's memory must be deallocated using :c:func:`PyObject_GC_Del`.
     76 
     77 
     78 .. c:function:: void PyObject_GC_Del(void *op)
     79 
     80    Releases memory allocated to an object using :c:func:`PyObject_GC_New` or
     81    :c:func:`PyObject_GC_NewVar`.
     82 
     83 
     84 .. c:function:: void PyObject_GC_UnTrack(void *op)
     85 
     86    Remove the object *op* from the set of container objects tracked by the
     87    collector.  Note that :c:func:`PyObject_GC_Track` can be called again on
     88    this object to add it back to the set of tracked objects.  The deallocator
     89    (:c:member:`~PyTypeObject.tp_dealloc` handler) should call this for the object before any of
     90    the fields used by the :c:member:`~PyTypeObject.tp_traverse` handler become invalid.
     91 
     92 
     93 .. c:function:: void _PyObject_GC_UNTRACK(PyObject *op)
     94 
     95    A macro version of :c:func:`PyObject_GC_UnTrack`.  It should not be used for
     96    extension modules.
     97 
     98 The :c:member:`~PyTypeObject.tp_traverse` handler accepts a function parameter of this type:
     99 
    100 
    101 .. c:type:: int (*visitproc)(PyObject *object, void *arg)
    102 
    103    Type of the visitor function passed to the :c:member:`~PyTypeObject.tp_traverse` handler.
    104    The function should be called with an object to traverse as *object* and
    105    the third parameter to the :c:member:`~PyTypeObject.tp_traverse` handler as *arg*.  The
    106    Python core uses several visitor functions to implement cyclic garbage
    107    detection; it's not expected that users will need to write their own
    108    visitor functions.
    109 
    110 The :c:member:`~PyTypeObject.tp_traverse` handler must have the following type:
    111 
    112 
    113 .. c:type:: int (*traverseproc)(PyObject *self, visitproc visit, void *arg)
    114 
    115    Traversal function for a container object.  Implementations must call the
    116    *visit* function for each object directly contained by *self*, with the
    117    parameters to *visit* being the contained object and the *arg* value passed
    118    to the handler.  The *visit* function must not be called with a *NULL*
    119    object argument.  If *visit* returns a non-zero value that value should be
    120    returned immediately.
    121 
    122 To simplify writing :c:member:`~PyTypeObject.tp_traverse` handlers, a :c:func:`Py_VISIT` macro is
    123 provided.  In order to use this macro, the :c:member:`~PyTypeObject.tp_traverse` implementation
    124 must name its arguments exactly *visit* and *arg*:
    125 
    126 
    127 .. c:function:: void Py_VISIT(PyObject *o)
    128 
    129    If *o* is not *NULL*, call the *visit* callback, with arguments *o*
    130    and *arg*.  If *visit* returns a non-zero value, then return it.
    131    Using this macro, :c:member:`~PyTypeObject.tp_traverse` handlers
    132    look like::
    133 
    134       static int
    135       my_traverse(Noddy *self, visitproc visit, void *arg)
    136       {
    137           Py_VISIT(self->foo);
    138           Py_VISIT(self->bar);
    139           return 0;
    140       }
    141 
    142 The :c:member:`~PyTypeObject.tp_clear` handler must be of the :c:type:`inquiry` type, or *NULL*
    143 if the object is immutable.
    144 
    145 
    146 .. c:type:: int (*inquiry)(PyObject *self)
    147 
    148    Drop references that may have created reference cycles.  Immutable objects
    149    do not have to define this method since they can never directly create
    150    reference cycles.  Note that the object must still be valid after calling
    151    this method (don't just call :c:func:`Py_DECREF` on a reference).  The
    152    collector will call this method if it detects that this object is involved
    153    in a reference cycle.
    154