Home | History | Annotate | Download | only in doc
      1 % -*- mode: latex; TeX-master: "Vorbis_I_spec"; -*-
      2 %!TEX root = Vorbis_I_spec.tex
      3 % $Id$
      4 \section{Floor type 1 setup and decode} \label{vorbis:spec:floor1}
      5 
      6 \subsection{Overview}
      7 
      8 Vorbis floor type one uses a piecewise straight-line representation to
      9 encode a spectral envelope curve. The representation plots this curve
     10 mechanically on a linear frequency axis and a logarithmic (dB)
     11 amplitude axis. The integer plotting algorithm used is similar to
     12 Bresenham's algorithm.
     13 
     14 
     15 
     16 \subsection{Floor 1 format}
     17 
     18 \subsubsection{model}
     19 
     20 Floor type one represents a spectral curve as a series of
     21 line segments.  Synthesis constructs a floor curve using iterative
     22 prediction in a process roughly equivalent to the following simplified
     23 description:
     24 
     25 \begin{itemize}
     26  \item  the first line segment (base case) is a logical line spanning
     27 from x_0,y_0 to x_1,y_1 where in the base case x_0=0 and x_1=[n], the
     28 full range of the spectral floor to be computed.
     29 
     30 \item the induction step chooses a point x_new within an existing
     31 logical line segment and produces a y_new value at that point computed
     32 from the existing line's y value at x_new (as plotted by the line) and
     33 a difference value decoded from the bitstream packet.
     34 
     35 \item floor computation produces two new line segments, one running from
     36 x_0,y_0 to x_new,y_new and from x_new,y_new to x_1,y_1. This step is
     37 performed logically even if y_new represents no change to the
     38 amplitude value at x_new so that later refinement is additionally
     39 bounded at x_new.
     40 
     41 \item the induction step repeats, using a list of x values specified in
     42 the codec setup header at floor 1 initialization time.  Computation
     43 is completed at the end of the x value list.
     44 
     45 \end{itemize}
     46 
     47 
     48 Consider the following example, with values chosen for ease of
     49 understanding rather than representing typical configuration:
     50 
     51 For the below example, we assume a floor setup with an [n] of 128.
     52 The list of selected X values in increasing order is
     53 0,16,32,48,64,80,96,112 and 128.  In list order, the values interleave
     54 as 0, 128, 64, 32, 96, 16, 48, 80 and 112.  The corresponding
     55 list-order Y values as decoded from an example packet are 110, 20, -5,
     56 -45, 0, -25, -10, 30 and -10.  We compute the floor in the following
     57 way, beginning with the first line:
     58 
     59 \begin{center}
     60 \includegraphics[width=8cm]{floor1-1}
     61 \captionof{figure}{graph of example floor}
     62 \end{center}
     63 
     64 We now draw new logical lines to reflect the correction to new_Y, and
     65 iterate for X positions 32 and 96:
     66 
     67 \begin{center}
     68 \includegraphics[width=8cm]{floor1-2}
     69 \captionof{figure}{graph of example floor}
     70 \end{center}
     71 
     72 Although the new Y value at X position 96 is unchanged, it is still
     73 used later as an endpoint for further refinement.  From here on, the
     74 pattern should be clear; we complete the floor computation as follows:
     75 
     76 \begin{center}
     77 \includegraphics[width=8cm]{floor1-3}
     78 \captionof{figure}{graph of example floor}
     79 \end{center}
     80 
     81 \begin{center}
     82 \includegraphics[width=8cm]{floor1-4}
     83 \captionof{figure}{graph of example floor}
     84 \end{center}
     85 
     86 A more efficient algorithm with carefully defined integer rounding
     87 behavior is used for actual decode, as described later.  The actual
     88 algorithm splits Y value computation and line plotting into two steps
     89 with modifications to the above algorithm to eliminate noise
     90 accumulation through integer roundoff/truncation.
     91 
     92 
     93 
     94 \subsubsection{header decode}
     95 
     96 A list of floor X values is stored in the packet header in interleaved
     97 format (used in list order during packet decode and synthesis).  This
     98 list is split into partitions, and each partition is assigned to a
     99 partition class.  X positions 0 and [n] are implicit and do not belong
    100 to an explicit partition or partition class.
    101 
    102 A partition class consists of a representation vector width (the
    103 number of Y values which the partition class encodes at once), a
    104 'subclass' value representing the number of alternate entropy books
    105 the partition class may use in representing Y values, the list of
    106 [subclass] books and a master book used to encode which alternate
    107 books were chosen for representation in a given packet.  The
    108 master/subclass mechanism is meant to be used as a flexible
    109 representation cascade while still using codebooks only in a scalar
    110 context.
    111 
    112 \begin{Verbatim}[commandchars=\\\{\}]
    113 
    114   1) [floor1_partitions] = read 5 bits as unsigned integer
    115   2) [maximum_class] = -1
    116   3) iterate [i] over the range 0 ... [floor1_partitions]-1 \{
    117 
    118         4) vector [floor1_partition_class_list] element [i] = read 4 bits as unsigned integer
    119 
    120      \}
    121 
    122   5) [maximum_class] = largest integer scalar value in vector [floor1_partition_class_list]
    123   6) iterate [i] over the range 0 ... [maximum_class] \{
    124 
    125         7) vector [floor1_class_dimensions] element [i] = read 3 bits as unsigned integer and add 1
    126 	8) vector [floor1_class_subclasses] element [i] = read 2 bits as unsigned integer
    127         9) if ( vector [floor1_class_subclasses] element [i] is nonzero ) \{
    128 
    129              10) vector [floor1_class_masterbooks] element [i] = read 8 bits as unsigned integer
    130 
    131            \}
    132 
    133        11) iterate [j] over the range 0 ... (2 exponent [floor1_class_subclasses] element [i]) - 1 \{
    134 
    135              12) array [floor1_subclass_books] element [i],[j] =
    136                  read 8 bits as unsigned integer and subtract one
    137            \}
    138       \}
    139 
    140  13) [floor1_multiplier] = read 2 bits as unsigned integer and add one
    141  14) [rangebits] = read 4 bits as unsigned integer
    142  15) vector [floor1_X_list] element [0] = 0
    143  16) vector [floor1_X_list] element [1] = 2 exponent [rangebits];
    144  17) [floor1_values] = 2
    145  18) iterate [i] over the range 0 ... [floor1_partitions]-1 \{
    146 
    147        19) [current_class_number] = vector [floor1_partition_class_list] element [i]
    148        20) iterate [j] over the range 0 ... ([floor1_class_dimensions] element [current_class_number])-1 \{
    149              21) vector [floor1_X_list] element ([floor1_values]) =
    150                  read [rangebits] bits as unsigned integer
    151              22) increment [floor1_values] by one
    152            \}
    153      \}
    154 
    155  23) done
    156 \end{Verbatim}
    157 
    158 An end-of-packet condition while reading any aspect of a floor 1
    159 configuration during setup renders a stream undecodable.  In addition,
    160 a \varname{[floor1_class_masterbooks]} or
    161 \varname{[floor1_subclass_books]} scalar element greater than the
    162 highest numbered codebook configured in this stream is an error
    163 condition that renders the stream undecodable.  All vector
    164 [floor1_x_list] element values must be unique within the vector; a
    165 non-unique value renders the stream undecodable.
    166 
    167 \paragraph{packet decode} \label{vorbis:spec:floor1-decode}
    168 
    169 Packet decode begins by checking the \varname{[nonzero]} flag:
    170 
    171 \begin{Verbatim}[commandchars=\\\{\}]
    172   1) [nonzero] = read 1 bit as boolean
    173 \end{Verbatim}
    174 
    175 If \varname{[nonzero]} is unset, that indicates this channel contained
    176 no audio energy in this frame.  Decode immediately returns a status
    177 indicating this floor curve (and thus this channel) is unused this
    178 frame.  (A return status of 'unused' is different from decoding a
    179 floor that has all points set to minimum representation amplitude,
    180 which happens to be approximately -140dB).
    181 
    182 
    183 Assuming \varname{[nonzero]} is set, decode proceeds as follows:
    184 
    185 \begin{Verbatim}[commandchars=\\\{\}]
    186   1) [range] = vector \{ 256, 128, 86, 64 \} element ([floor1_multiplier]-1)
    187   2) vector [floor1_Y] element [0] = read \link{vorbis:spec:ilog}{ilog}([range]-1) bits as unsigned integer
    188   3) vector [floor1_Y] element [1] = read \link{vorbis:spec:ilog}{ilog}([range]-1) bits as unsigned integer
    189   4) [offset] = 2;
    190   5) iterate [i] over the range 0 ... [floor1_partitions]-1 \{
    191 
    192        6) [class] = vector [floor1_partition_class]  element [i]
    193        7) [cdim]  = vector [floor1_class_dimensions] element [class]
    194        8) [cbits] = vector [floor1_class_subclasses] element [class]
    195        9) [csub]  = (2 exponent [cbits])-1
    196       10) [cval]  = 0
    197       11) if ( [cbits] is greater than zero ) \{
    198 
    199              12) [cval] = read from packet using codebook number
    200                  (vector [floor1_class_masterbooks] element [class]) in scalar context
    201           \}
    202 
    203       13) iterate [j] over the range 0 ... [cdim]-1 \{
    204 
    205              14) [book] = array [floor1_subclass_books] element [class],([cval] bitwise AND [csub])
    206              15) [cval] = [cval] right shifted [cbits] bits
    207 	     16) if ( [book] is not less than zero ) \{
    208 
    209 	           17) vector [floor1_Y] element ([j]+[offset]) = read from packet using codebook
    210                        [book] in scalar context
    211 
    212                  \} else [book] is less than zero \{
    213 
    214 	           18) vector [floor1_Y] element ([j]+[offset]) = 0
    215 
    216                  \}
    217           \}
    218 
    219       19) [offset] = [offset] + [cdim]
    220 
    221      \}
    222 
    223  20) done
    224 \end{Verbatim}
    225 
    226 An end-of-packet condition during curve decode should be considered a
    227 nominal occurrence; if end-of-packet is reached during any read
    228 operation above, floor decode is to return 'unused' status as if the
    229 \varname{[nonzero]} flag had been unset at the beginning of decode.
    230 
    231 
    232 Vector \varname{[floor1_Y]} contains the values from packet decode
    233 needed for floor 1 synthesis.
    234 
    235 
    236 
    237 \paragraph{curve computation} \label{vorbis:spec:floor1-synth}
    238 
    239 Curve computation is split into two logical steps; the first step
    240 derives final Y amplitude values from the encoded, wrapped difference
    241 values taken from the bitstream.  The second step plots the curve
    242 lines.  Also, although zero-difference values are used in the
    243 iterative prediction to find final Y values, these points are
    244 conditionally skipped during final line computation in step two.
    245 Skipping zero-difference values allows a smoother line fit.
    246 
    247 Although some aspects of the below algorithm look like inconsequential
    248 optimizations, implementors are warned to follow the details closely.
    249 Deviation from implementing a strictly equivalent algorithm can result
    250 in serious decoding errors.
    251 
    252 \begin{description}
    253 \item[step 1: amplitude value synthesis]
    254 
    255 Unwrap the always-positive-or-zero values read from the packet into
    256 +/- difference values, then apply to line prediction.
    257 
    258 \begin{Verbatim}[commandchars=\\\{\}]
    259   1) [range] = vector \{ 256, 128, 86, 64 \} element ([floor1_multiplier]-1)
    260   2) vector [floor1_step2_flag] element [0] = set
    261   3) vector [floor1_step2_flag] element [1] = set
    262   4) vector [floor1_final_Y] element [0] = vector [floor1_Y] element [0]
    263   5) vector [floor1_final_Y] element [1] = vector [floor1_Y] element [1]
    264   6) iterate [i] over the range 2 ... [floor1_values]-1 \{
    265 
    266        7) [low_neighbor_offset] = \link{vorbis:spec:low:neighbor}{low_neighbor}([floor1_X_list],[i])
    267        8) [high_neighbor_offset] = \link{vorbis:spec:high:neighbor}{high_neighbor}([floor1_X_list],[i])
    268 
    269        9) [predicted] = \link{vorbis:spec:render:point}{render_point}( vector [floor1_X_list] element [low_neighbor_offset],
    270 				      vector [floor1_final_Y] element [low_neighbor_offset],
    271                                       vector [floor1_X_list] element [high_neighbor_offset],
    272 				      vector [floor1_final_Y] element [high_neighbor_offset],
    273                                       vector [floor1_X_list] element [i] )
    274 
    275       10) [val] = vector [floor1_Y] element [i]
    276       11) [highroom] = [range] - [predicted]
    277       12) [lowroom]  = [predicted]
    278       13) if ( [highroom] is less than [lowroom] ) \{
    279 
    280             14) [room] = [highroom] * 2
    281 
    282           \} else [highroom] is not less than [lowroom] \{
    283 
    284             15) [room] = [lowroom] * 2
    285 
    286           \}
    287 
    288       16) if ( [val] is nonzero ) \{
    289 
    290             17) vector [floor1_step2_flag] element [low_neighbor_offset] = set
    291             18) vector [floor1_step2_flag] element [high_neighbor_offset] = set
    292             19) vector [floor1_step2_flag] element [i] = set
    293             20) if ( [val] is greater than or equal to [room] ) \{
    294 
    295                   21) if ( [highroom] is greater than [lowroom] ) \{
    296 
    297                         22) vector [floor1_final_Y] element [i] = [val] - [lowroom] + [predicted]
    298 
    299 		      \} else [highroom] is not greater than [lowroom] \{
    300 
    301                         23) vector [floor1_final_Y] element [i] = [predicted] - [val] + [highroom] - 1
    302 
    303                       \}
    304 
    305                 \} else [val] is less than [room] \{
    306 
    307 		  24) if ([val] is odd) \{
    308 
    309                         25) vector [floor1_final_Y] element [i] =
    310                             [predicted] - (([val] + 1) divided by  2 using integer division)
    311 
    312                       \} else [val] is even \{
    313 
    314                         26) vector [floor1_final_Y] element [i] =
    315                             [predicted] + ([val] / 2 using integer division)
    316 
    317                       \}
    318 
    319                 \}
    320 
    321           \} else [val] is zero \{
    322 
    323             27) vector [floor1_step2_flag] element [i] = unset
    324             28) vector [floor1_final_Y] element [i] = [predicted]
    325 
    326           \}
    327 
    328      \}
    329 
    330  29) done
    331 
    332 \end{Verbatim}
    333 
    334 
    335 
    336 \item[step 2: curve synthesis]
    337 
    338 Curve synthesis generates a return vector \varname{[floor]} of length
    339 \varname{[n]} (where \varname{[n]} is provided by the decode process
    340 calling to floor decode).  Floor 1 curve synthesis makes use of the
    341 \varname{[floor1_X_list]}, \varname{[floor1_final_Y]} and
    342 \varname{[floor1_step2_flag]} vectors, as well as [floor1_multiplier]
    343 and [floor1_values] values.
    344 
    345 Decode begins by sorting the scalars from vectors
    346 \varname{[floor1_X_list]}, \varname{[floor1_final_Y]} and
    347 \varname{[floor1_step2_flag]} together into new vectors
    348 \varname{[floor1_X_list]'}, \varname{[floor1_final_Y]'} and
    349 \varname{[floor1_step2_flag]'} according to ascending sort order of the
    350 values in \varname{[floor1_X_list]}.  That is, sort the values of
    351 \varname{[floor1_X_list]} and then apply the same permutation to
    352 elements of the other two vectors so that the X, Y and step2_flag
    353 values still match.
    354 
    355 Then compute the final curve in one pass:
    356 
    357 \begin{Verbatim}[commandchars=\\\{\}]
    358   1) [hx] = 0
    359   2) [lx] = 0
    360   3) [ly] = vector [floor1_final_Y]' element [0] * [floor1_multiplier]
    361   4) iterate [i] over the range 1 ... [floor1_values]-1 \{
    362 
    363        5) if ( [floor1_step2_flag]' element [i] is set ) \{
    364 
    365              6) [hy] = [floor1_final_Y]' element [i] * [floor1_multiplier]
    366  	     7) [hx] = [floor1_X_list]' element [i]
    367              8) \link{vorbis:spec:render:line}{render_line}( [lx], [ly], [hx], [hy], [floor] )
    368              9) [lx] = [hx]
    369 	    10) [ly] = [hy]
    370           \}
    371      \}
    372 
    373  11) if ( [hx] is less than [n] ) \{
    374 
    375         12) \link{vorbis:spec:render:line}{render_line}( [hx], [hy], [n], [hy], [floor] )
    376 
    377      \}
    378 
    379  13) if ( [hx] is greater than [n] ) \{
    380 
    381             14) truncate vector [floor] to [n] elements
    382 
    383      \}
    384 
    385  15) for each scalar in vector [floor], perform a lookup substitution using
    386      the scalar value from [floor] as an offset into the vector \link{vorbis:spec:floor1:inverse:dB:table}{[floor1_inverse_dB_static_table]}
    387 
    388  16) done
    389 
    390 \end{Verbatim}
    391 
    392 \end{description}
    393