c-ZJsDddlZdZdZdZdZdZdZdZdZd Z d Z d Z d Z d Z dZdZd ZdZej$dedzezZej$dedzezZej$dedzezZej,dZej,dZej,dZej,dZej,dZdZdZdZdZdZ d5dZ!dZ"dZ#dZ$dZ%d Z&d!Z'd"Z(d#Z)d$Z*e+ee,e"e,e"e-e#e.e#e/e'e0e&e1e)e2de*i Z3d%Z4Gd&d'e5Z6d(Z7ej,dZ8ej,d)Z9ej,d*Z:ej,d+Z;dZdZ?dZ@dZAd6d,ZBd7d-ZCGd.d/e+ZDGd0d1ZEGd2d3ZFd4ZGy)8Niz>Bz>BBz>BHz>BLz>BQc@|dkrtj|dz|zS|dkrtj|dzdz|S|dkrtj|dzdz|S|dkrtj|dzdz|St j|dzdz|S) z6Obtain a value encoding the major type and its length.rrlrr)ENCODED_LENGTH_1packENCODED_LENGTH_2ENCODED_LENGTH_3ENCODED_LENGTH_4ENCODED_LENGTH_5) majortypelengths r+)r,r3r-s rstreamencodearrayfromiterrBs2 ! !!_EK% Ks-/c0t|j|fSr#)type__name__r&s r_mixedtypesortkeyrFs 7  Q r!c#~Kttttt |t D]}|yw)Nkey)r MAJOR_TYPE_SEMANTICSEMANTIC_TAG_FINITE_SETr?sortedrF)sr-s rstreamencodesetrNs4 *,C DD"6!1B#CD Es;=c#Kttt|t|j dD]-\}}t |D]}|t |D]}|/yw)z_Encode dictionary to a generator. Does not supporting indefinite length dictionaries. ct|dSNr)rF)xs rz!streamencodemap..s6G!6Mr!rHN)r MAJOR_TYPE_MAPr%rLitemsr>)drIvaluer-s rstreamencodemaprXs^ ~s1v ..QWWY,MN U!#&EK'!%(EK)OsA)A+c#Kt|D]-\}}t|D]}|t|D]}|/tyw)zFGiven an iterable of (key, value), encode to an indefinite length map.N)BEGIN_INDEFINITE_MAPr>r+)r,rIrWr-s rstreamencodemapfromiterr[sI  U!#&EK'!%(EK) KsAAc#"K|rdydyw)N)bs rstreamencodeboolras'#G#s c#Kdyw)Nr_r&s rstreamencodenonerds Msctj|j}|s"tD]}t||st|}n|st dt |z||S)a1Encode a value in a streaming manner. Given an input object, encode it to CBOR recursively. Returns a generator of CBOR encoded bytes. There is no guarantee that each emitted chunk fully decodes to a value or sub-value. Encoding is deterministic - unordered collections are sorted. sdo not know how to encode %s)STREAM_ENCODERSget __class__ isinstancer7rD)r'fntys rr>r>sb   Q[[ )B !Ba$ $B  " 847BCC a5Lr!ceZdZdZy)CBORDecodeErrorz"Represents an error decoding CBOR.N)rE __module__ __qualname____doc__r_r!rrmrms,r!rmc ||Sr#r_)r`r3s r_elementtointegerrrs Q4Kr!s>Hs>Ls>Qct||}|dz }|dz }|tz}|tk(r*t|||\}}}|r d||dztfSdd|tfS|t k(r.t|||\}}}|rd| dz |dztfSdd|tfS|t k(r{t|||d\}}}|s dd|tfS|P||z|zt|kr|||z||z|z}d|||zdztfSt||z |z |z } dd| tfSdddtfS|tk(r td|tk(r*t|||\}}}|r d||dztfSdd|tfS|tk(r*t|||\}}}|r d||dztfSdd|tfS|tk(rt|||\}} }|s dd|tfS| t k(r_||zt|k\r dddtfSt#|||z\}}} } |s dd| tfS| tk7r td d||| zdzt$fStd | z|t&k(rZ|t(k(r dddtfS|t*k(r dddtfS|t,k(r dddtfS|t.k(r dddt0fStd |zJ) aDecode a new CBOR value from a buffer at offset. This function attempts to decode up to one complete CBOR value from ``b`` starting at offset ``offset``. The beginning of a collection (such as an array, map, set, or indefinite length bytestring) counts as a single value. For these special cases, a state flag will indicate that a special value was seen. When called, the function either returns a decoded value or gives a hint as to how many more bytes are needed to do so. By calling the function repeatedly given a stream of bytes, the caller can build up the original values. Returns a tuple with the following elements: * Bool indicating whether a complete value was decoded. * A decoded value if first value is True otherwise None * Integer number of bytes. If positive, the number of bytes read. If negative, the number of bytes we need to read to decode this value or the next chunk in this value. * One of the ``SPECIAL_*`` constants indicating special treatment for this value. ``SPECIAL_NONE`` means this is a fully decoded simple value (such as an integer or bool). rrTFN)allowindefinitesstring major type not supporteds,expected array after finite set semantic tagssemantic tag %d not allowedsspecial type %d not allowed)rr SUBTYPE_MASKr8 decodeuint SPECIAL_NONEr9r$r%#SPECIAL_START_INDEFINITE_BYTESTRINGMAJOR_TYPE_STRINGrmr=SPECIAL_START_ARRAYrTSPECIAL_START_MAPrJrK decodeitemSPECIAL_START_SETMAJOR_TYPE_SPECIAL SUBTYPE_FALSE SUBTYPE_TRUE SUBTYPE_NULLSUBTYPE_INDEFINITESPECIAL_INDEFINITE_BREAK) r`offsetinitialrsubtypecompleterW readcountsizewantedtagvalue readcount2specials rr}r} so6 6*G aKF1 I $GO#%/F%C"%  A |; ;$ <7 7 ' '%/F%C"% %!Y]L@ @$ <7 7 + +%/ Q% !$ $ <7 7   !D(CF2&9,v /AD/HIUI$4q$8,FFQ&94t;dFL88q"EE E ' '@AA & &%/w6$B!$ y1}.AA A$ <7 7 n $%/w6$B!$ y1}.?? ?$ <7 7 ) )(27Av(F%(I$ <7 7 . . !SV+dB 442<6I%3 /HdJdJ <<--%Cy:59;LL L""@8"KL L ( ( m #</ /  $q,. .  $q,. . * *q":: :""@7"JK Kur!c|dkrd|dfS|dk(r|rytd|dk\rtd|z|dk(rt}n/|d k(rt}n#|d k(rt}n|d k(rt}n td t ||z |j k\r"d|j||d|j fSd dt ||z |j z fS)aDecode an unsigned integer. ``subtype`` is the lower 5 bits from the initial byte CBOR item "header." ``b`` is a buffer containing bytes. ``offset`` points to the index of the first byte after the byte that ``subtype`` was derived from. ``allowindefinite`` allows the special indefinite length value indicator. Returns a 3-tuple of (successful, value, count). The first element is a bool indicating if decoding completed. The 2nd is the decoded integer value or None if not fully decoded or the subtype is 31 and ``allowindefinite`` is True. The 3rd value is the count of bytes. If positive, it is the number of additional bytes decoded. If negative, it is the number of additional bytes needed to decode this value. rTrr )TNrs'indefinite length uint not allowed heres'unsupported subtype on integer type: %drrrs#bounds condition checking violationFN)rmSTRUCT_BIG_UBYTESTRUCT_BIG_USHORTSTRUCT_BIG_ULONGSTRUCT_BIG_ULONGLONGr%r unpack_from)rr`rrtrMs rrwrws*|Wa B  !"LM M B 6 @  "}  B  B  B DEE 1v!&& Q]]1f-a0!&&88dCFVOaff444r!ceZdZdZddZy)bytestringchunkaRepresents a chunk/segment in an indefinite length bytestring. This behaves like a ``bytes`` but in addition has the ``isfirst`` and ``islast`` attributes indicating whether this chunk is the first or last in an indefinite length bytestring. cNtj||}||_||_|Sr#)bytes__new__isfirstislast)clsr'firstlastselfs rrzbytestringchunk.__new__s%}}S!$   r!N)FF)rErnrorprr_r!rrrs r!rcPeZdZdZdZdZdZdZdZdZ dZ d Z e d Z dd Zd Zy ) sansiodecoderaA CBOR decoder that doesn't perform its own I/O. To use, construct an instance and feed it segments containing CBOR-encoded bytes via ``decode()``. The return value from ``decode()`` indicates whether a fully-decoded value is available, how many bytes were consumed, and offers a hint as to how many bytes should be fed in next time to decode the next value. The decoder assumes it will decode N discrete CBOR values, not just a single value. i.e. if the bytestream contains uints packed one after the other, the decoder will decode them all, rather than just the initial one. When ``decode()`` indicates a value is available, call ``getavailable()`` to return all fully decoded values. ``decode()`` can partially decode input. It is up to the caller to keep track of what data was consumed and to pass unconsumed data in on the next invocation. The decoder decodes atomically at the *item* level. See ``decodeitem()``. If an *item* cannot be fully decoded, the decoder won't record it as partially consumed. Instead, the caller will be instructed to pass in the initial bytes of this item on the next invocation. This does result in some redundant parsing. But the overhead should be minimal. This decoder only supports a subset of CBOR as required by Mercurial. It lacks support for: * Indefinite length arrays * Indefinite length maps * Use of indefinite length bytestrings as keys or values within arrays, maps, or sets. * Nested arrays, maps, or sets within sets * Any semantic tag that isn't a mathematical finite set * Floating point numbers * Undefined special value CBOR types are decoded to Python types as follows: uint -> int negint -> int bytestring -> bytes map -> dict array -> list True -> bool False -> bool null -> None indefinite length bytestring chunk -> [bytestringchunk] The only non-obvious mapping here is an indefinite length bytestring to the ``bytestringchunk`` type. This is to facilitate streaming indefinite length bytestrings out of the decoder and to differentiate a regular bytestring from an indefinite length bytestring. rrrrrrrc^d|_|j|_g|_d|_g|_yrQ)decodedbytecount _STATE_NONE_state_collectionstack_currentmapkey_decodedvaluesrs r__init__zsansiodecoder.__init__'s7 !"&& !##!r!c4|j|jk7S)z2Whether the decoder has partially decoded a value.)rrrs r inprogresszsansiodecoder.inprogress:s{{d....r!c|st|jddfS|}|t|kr~t||\}}}}|dkDr|xj|z c_|s#|dksJt|j||z | fS||z }|j |j k(r|tk(r|jj|n|tk(r1|jj|gd|j|_n|tk(r1|jj|id|j|_nu|tk(r9|jj|td|j |_n3|t"k(r|j$|_nt'd|z|j |jk(r|tk(r2|jd}|dj||dxxdzcc<n|tk(rR|jd} g} | dj| | dxxdzcc<|jj|| dnY|tk(rc|jd} i} | dj| | dxxdzcc<|jj|| d|j|_n|tk(rk|jd} t} | dj| | dxxdzcc<|jj|| d|j |_ny|t"k(r t'dt'd |z|j |jk(rc|tk(r||_|j*|_n|t"k(r t'd |tttfvr t'd t'd |z|j |j*k(r|tk(rA|jd} || d|j(<| dxxdzcc<|j|_ne|tk(r`|jd} g} | | d|j(<| dxxdzcc<|jj|| d|j|_n|tk(r`|jd} i} | | d|j(<| dxxdzcc<|jj|| d|j|_n|tk(rh|jd} t} | | d|j(<| dxxdzcc<|jj|| d|j |_n"|t"k(r t'd t'd|zd|_n |j |j k(r{|tk(r2|jd} | dj-|| dxxdzcc<n|t"k(r t'd|tttfvr t'dt'd|z|j |j$k(r|tk(r9|jjt/|d|j0|_n|t2k(rG|jjt/ddd|jrJ|j |_nt'd|z|j |j0k(r|tk(r%|jjt/|nu|t2k(rF|jjt/dd|jrJ|j |_n&t'd|zt'd|j z |j |j|j|j fvrn|jd} | drn|jj5|jrTt6|jt8|jt|j it;|jdd|_n/|jj| d|j |_|t|kr~t|j||z dfS)aAttempt to decode bytes from an input buffer. ``b`` is a collection of bytes and ``offset`` is the byte offset within that buffer from which to begin reading data. ``b`` must support ``len()`` and accessing bytes slices via ``__slice__``. Typically ``bytes`` instances are used. Returns a tuple with the following fields: * Bool indicating whether values are available for retrieval. * Integer indicating the number of bytes that were fully consumed, starting from ``offset``. * Integer indicating the number of bytes that are desired for the next call in order to decode an item. r) remainingvsunhandled special state: %drurrrs9indefinite length bytestrings not allowed as array valuess5unhandled special item when expecting array value: %ds5indefinite length bytestrings not allowed as map keyss%collections not supported as map keyss1unhandled special item when expecting map key: %ds7indefinite length bytestrings not allowed as map valuess3unhandled special item when expecting map value: %dNs7indefinite length bytestrings not allowed as set valuess%collections not allowed as set valuess3unhandled special item when expecting set value: %dT)rr!)rrs<unexpected special value when expecting bytestring chunk: %d)rsunhandled decoder state: %d)boolrr%r}rrrrxappendr{r_STATE_WANT_ARRAY_VALUEr|_STATE_WANT_MAP_KEYr~set_STATE_WANT_SET_VALUEry"_STATE_WANT_BYTESTRING_CHUNK_FIRSTrmr_STATE_WANT_MAP_VALUEaddr'_STATE_WANT_BYTESTRING_CHUNK_SUBSEQUENTrpoplistdictrD) rr`r initialoffsetrrWrrclastcnewvalues rdecodezsansiodecoder.decode?s "++,a2 2 s1vo3=Q2G /HeY1}%%2% 1}$},,-]*J i F{{d...l*''..u5 33))00*/"$ #'">">DK 11))00*/"$ #'":":DK 11))00*/"%% #'"<"?  8 88l**/D'"&"<"">DK 11 11"5E!H7?E$K 3 34,'1,'))00*/"*#'":":DK 11 11"5E"uH7?E$K 3 34,'1,'))00*/"*#'"<"t|j}g|_|S)zReturns an iterator over fully decoded values. Once values are retrieved, they won't be available on the next call. )rr)rr4s r getavailablezsansiodecoder.getavailables! $$ % r!Nr)rErnrorprrrrrrrrpropertyrrrr_r!rrrsX6pK)*&./+!&//G R r!rc"eZdZdZdZdZdZy)bufferingdecoderahA CBOR decoder that buffers undecoded input. This is a glorified wrapper around ``sansiodecoder`` that adds a buffering layer. All input that isn't consumed by ``sansiodecoder`` will be buffered and concatenated with any new input that arrives later. TODO consider adding limits as to the maximum amount of data that can be buffered. c>t|_g|_d|_yrQ)r_decoder_chunks_wantedrs rrzbufferingdecoder.__init__s%   r!cvt|tr t|}|jrt ||j krH|jj ||xj t |zc_dd|j fSt |}|jj |dj|j}g|_t ||z }nd}|jj|\}}}||_|t |kr|jj ||d|||z |fS)a0Attempt to decode bytes to CBOR values. Returns a tuple with the following fields: * Bool indicating whether new values are available for retrieval. * Integer number of bytes decoded from the new input. * Integer number of bytes wanted to decode the next value. Frr!N) ri bytearrayrrr%rrjoinrr)rr`newlenoldlen availablerrs rrzbufferingdecoder.decodes  a #aA <<1v $ ##A& A& a--VF LL   "&ADLVf_FF'+}}';';A'>$ 9f s1v  LL  )* .)f,f44r!c6|jjSr#)rrrs rrzbufferingdecoder.getavailables}}))++r!N)rErnrorprrrr_r!rrrs 15f,r!rc|sgSt}|j|\}}}|t|k7r td|jr td|j S)avDecode all CBOR items present in an iterable of bytes. In addition to regular decode errors, raises CBORDecodeError if the entirety of the passed buffer does not fully decode to complete CBOR values. This includes failure to decode any value, incomplete collection types, incomplete indefinite length items, and extra data at the end of the buffer. sinput data not fully consumedsinput data not complete)rrr%rmrr)r`decoder havevaluesr wantbytess r decodeallrsd  oG'.~~a'8$J 9CF>??899    !!r!)rr)rF)Hstructr8r9r$rzr=rTrJrrvrrrSUBTYPE_HALF_FLOATSUBTYPE_SINGLE_FLOATSUBTYPE_DOUBLE_FLOATrrKrr*rArZStructrrrrrr+ BREAK_INTr r(r.r5r;r?rBrFrNrXr[rardrintrtuplerrrrDrfr> Exceptionrmrrrrrrrxryr{r|r~rr}rwrrrrr_r!rrsr    *fkk 1 $'9 9% a "4 4#v{{.A  2 2!6==& 6==' 6==' 6==' 6=='    B .:   $   !  / J  4-i-!6==&!FMM%( 6=='$v}}U+ &'#Wt05f e  jjZD,D,N"r!