{aBdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z mZmZmZdZej$ZdZdZGdd eZd Zd Zd Zd ZdZdZdZdZdZ dZ!dZ"dZ#e$dk(rejJe#yy)z A tool for creating block maps (bmap) and copying disk images using bmap files. Documentation can be found here: source.tizen.org/documentation/reference/bmaptool N) BmapCreateBmapCopy BmapHelpers TransReadz3.8.0c(g}tjdr#tjj }n/tj Dcgc]}|j }}d}t|dz }|t|kr0||jdr|dz }|}n|dz }|t|kr0|d|}|r%tjddj||r||z}n t|}tj|ycc}w)z9Print an error message occurred along with the traceback.rrz File "z-An error occurred, here is the traceback: %s  N) sysexc_info traceback format_exc splitlines format_stackstriplen startswithlogerrorjoinstr) msgformatargstbacklineslineidxlast_idxerrmsgs 1/usr/lib/python3.12/site-packages/bmaptool/CLI.pyprint_error_with_tbr!1s E ||~a$$&113*3*@*@*BC*B$*BC C5zA~H E  :  , 1HCH 1HC E  !H E  CTYYuEUV T!YIIf'DsDcHtt|dzg|td)z7Print an error message and terminate program execution.r r)r!r SystemExit)rrs r error_outr$Os$I-55 Q-ceZdZdZdZdZy) NamedFileao This simple class allows us to override the 'name' attribute of a file object. The reason is that some classes use the 'name' attribute of the file object to print file path. But, for example, 'os.fdopen()' sets the name to "", which is not very user-friendly. Also, sometimes we want to substitute the file name with something else. c ||_||_yN) _file_objname)selffile_objr+s r __init__zNamedFile.__init___s! r%c.t|j|Sr))getattrr*)r,r+s r __getattr__zNamedFile.__getattr__cst~~t,,r%N)__name__ __module__ __qualname____doc__r.r1r%r r'r'Vs-r%r'cj tj|tjtjz} tj d}t|S#t$r}t d||Yd}~>d}~wwxYw#t$r,}tjt d||Yd}~_d}~wwxYw)am This is a helper function for 'open_files()' which is called if the destination file of the "copy" command is a block device. We handle block devices a little bit different to regular files. Namely, we are trying to make sure that we do not write to a mounted block device, otherwise the user could corrupt, say, the root file system by a mistake. This is achieved by opening the block device in exclusive mode, which guarantees that we are the only users of the block device. This function opens a block device specified by 'path' in exclusive mode. Returns opened file object. z3cannot open block device '%s' in exclusive mode: %sNwbz!cannot open block device '%s': %s) osopenO_WRONLYO_EXCLOSErrorr$fdopencloser')path descriptorerrr-s r open_block_devicerCgsTWWT2;;#:; C99Z. Xt $$ TGsSST C 6cBBCs.5AA= A:# A55A:= B2"B--B2cddl}|D]}|j|jjzdk7rx|j |j }|j djd|j djd}tjd|d|j dtd|j |jd jy) z This is a helper function which reports the GPG signature verification results. The 'context' argument is the gpg context object, and the 'sigs' argument contains the results of the 'gpg.verify()' function. rNz <>z-successfully verified bmap file signature of z (fingerprint )zsignature verification failed (fingerprint %s): %s Either fix the problem or use --no-sig-verify to disable signature verificationr )gpgsummary constants SIGSUM_VALIDget_keyfpruidsr+emailrinfor$statuslower)contextsigsrGsigkeyauthors r report_verification_resultsrWs KK#--44 4 ://#''*C"%((1+"2"2CHHQK4E4EFF HH&,cgg7  1 1 ##%  r%c|jry|jr- tj|j}|j}n3 |dz}tj|}t j d|zjrO tjd}tj||jd|j|} ddl} j#}t%j&|j(} t%j&|j(} |j+| | dd j,} |jt7 dk(rt j9d |zyt;| y#tj$r"}t d|j|Yd}~d}~wwxYw#tj$r: |dz}tj|}n#tj$rYYywxYwYwxYw#t$r}t d|Yd}~d}~wwxYw#t $rt d YuwxYw#j.j0$r&}t d |j3|Yd}~Dd}~w|j.j4$r}t d |Yd}~rd}~wwxYw)zp This is a helper function for 'verify_bmap_signature()' which handles the detached signature case. Nz(cannot open bmap signature file '%s': %sz.ascz.sigz'discovered signature file for bmap '%s'wb+z4cannot create a temporary file for the signature: %srzcannot verify the signature because the python "gpg" module is not installed on your system Please, either install the module or use --no-sig-verifyrzYfailure when trying to verify GPG signature: %s Make sure file "%s" has proper GPG format#discovered a BAD GPG signature: %s zFthe "%s" signature file does not actually contain any valid signatures) no_sig_verifybmap_sigrErrorr$rrOis_urltempfileNamedTemporaryFileIOErrorshutil copyfileobjseekr?rG ImportErrorContextioFileIOr+verify signatureserrors GPGMEError getstring BadSignaturesrwarningrW) rbmap_obj bmap_pathsig_objrBsig_pathtmp_objrGrR signature signed_datarSs r verify_detached_bmap_signaturerwsn   }} W))$--8G==  6)H))(3G :XEF~~ T11%8G 7G, Q   D++-IIgll+ ii . ~~k9d;A>II MMO 4yA~  #%- .   $GT2 A W A4==RU V V W  $v-#--h7??    T Ms S S T   8   ::   8 MMO    :: # #D8(CCDsF GHH8A.I G F==GHG43H4H H H  HH H5 H00H58IIK,J  K) J;;KcR|jr td ddl} j }t j |j}t j}|j||d}|js0t!dk(rt"j%dn t'| t)j*d }j/j1|j3d|S#t$rtdYwxYw#jj$r'}td|djYd}~d}~w|jj$r}tdtYd}~ d}~wwxYw#t,$r}td |Yd}~d}~wwxYw) zp This is a helper function for 'verify_bmap_signature()' which handles the clarsign signature case. znthe bmap file has clearsign format and already contains the signature, so --bmap-sig option should not be usedrNzcannot verify the signature because the python "gpg"module is not installed on your system Cannot extract block map from the bmap file which has clearsign format, please, install the modulez]failure when trying to verify GPG signature: %s make sure the bmap file has proper GPG formatr rZzPthe bmap file clearsign signature does not actually contain any valid signaturesw++cannot create a temporary file for bmap: %s)r\r$rGrerfrgrhr+BytesIOrirkrlrQrnrsr[rrrorWr_ TemporaryFilerawritegetvaluerd) rrprGrRru plaintextrSrBrts r verify_clearsign_bmap_signaturersp  }} E   D++-IIhmm, JJL ~~iD9    t9> KK/  ( 6G((. MM)$$&' LLO NM   )   ::   < FLLN  :: # #D8(CCD G@#FFGsMC8AD1F8DDF+E  F)E??F F& F!!F&c|syd}|jt|}|jd||k(r t||St |||S)ak Verify GPG signature of the bmap file if it is present. The signature may be in a separate file (detached) or it may be inside the bmap file itself (clearsign signature). If user specifies the --bmap-sig option, the signature is assumed to be detached and is taken from the user-specified file. Otherwise, this function verifies whether the bmap file has clearsign signature, and if not, it tries to automatically discover the detached signature by searching for a ".sig" or ".asc" file at the same path and with the same basename as the bmap file. This function then verifies the signature and reports the results. In case of the clearsign signature, the bmap file has "invalid" format, meaning that the proper bmap XML contents is in the GPG clearsign container. The XML contents has to be extracted from the container before further processing. And this is be done even if user specified the --no-sig-verify option. This function returns an open file object with the extracted XML bmap file contents in this case. Otherwise, this function returns None. Nz"-----BEGIN PGP SIGNED MESSAGE-----r)readrrdrrw)rrprqclearsign_markerbufs r verify_bmap_signaturer%sU. ; --,- .C MM! .tX>>-dHiHHr%c*|jry|jr- tj|j}|j}nA|j } |dz} tj|}t jd|z js||fS tjd}tj ||j#|j%d |j'||fS#tj$r!}t d|j|Yd}~d}~wwxYw#tj$rYnwxYwtjj|\}}|dk(ry#t$r}t d|Yd}~d}~wwxYw) a` This is a helper function for 'open_files()' which discovers and opens the bmap file, then returns the corresponding file object and the bmap file path. If the user specified the bmap file explicitly, we just open the provided path. Otherwise, we try to discover the bmap file at the same place where the image file is located. We search for a file with the same path and basename, but with a ".bmap" extension. Additionally, this function makes sure that the returned file object corresponds to a local file, not a remote file. We do this by creating a temporary local copy of the bmap file. The reason is that further on we may need to check the GPG signature of the file, which requires it to be a local file. On top of that, the BmapCopy class requires the bmap file to be memory-mappable ('mmap()'). NNzcannot open bmap file '%s': %sNz.bmapzdiscovered bmap file '%s'rYrzr)nobmapbmaprr]r$imagerrOr9r@splitextr^r_r`rarbrcflushrdr?)rrprBrq image_pathextrts r find_and_open_bmaprIsp& {{ yy I **4995HII ZZ "W,I $..y94y@A ??)$$G--e4 x) MMO LLO NN Y C I 7C H H I??  !gg..z:OJby#& G@#FFGsAC9-D0E39D- D((D-0EE3 F< F  Fc* tj|j}t |\}}||jk(r|j tdt jj|jjdrt jj|js1tjd|jd|jdn^tjt j|jj r"tjd|jzd} t#j$|jj'rd }t)|j}nt+|jd }|||j.|fS#tj$r}td|zYd}~d}~wwxYw#t,$r!}td |j|Yd}~fd}~wwxYw) a This is a helper function for 'copy_command()' which the image, bmap, and the destination files. Returns a tuple of 5 elements: 1 file-like object for the image 2 file object for the destination file 3 file-like object for the bmap 4 full path to the bmap file 5 image size in bytes 6 'True' if the destination file is a block device, otherwise 'False' zcannot open image: %sNzaMake sure you are writing your image and not the bmap file (you specified the same path for them)z/dev/"z+" does not exist, creating a regular file "zA"%s" is under "/dev", but it is a regular file, not a device nodeFTrYz%cannot open destination file '%s': %s)rrr]r$rr?r9r@normpathdestrexistsrrostatS_ISREGst_modepathlibPathis_block_devicerCr:rasize)r image_objrBrprqdest_is_blkdevdest_objs r open_filesrs2'' 3 /t4XyDJJ  5  ww "--g6ww~~dii( KK))TYY0 \\"''$)),44 5 KK$&*ii0 NL << " 2 2 4!N(3HDIIu-H x9innn UUa ??2*S0112Z L:DIIsKKLs0F9 AG(9G% G  G%( H1H  Hc |jr|jr td|jr|jr tdt |\}}}}}}|jr |s tdt |||}|r|j|}|r t||} |r(d|jz}tj||||} nDdtjj|jz}tj||||} |j sh|j"s\t$j&j)r>t$j*j)r  j-t$j&dt/j.} |s;|jr#t0j3d|jzntd nt0j3d  j4zt0j3d | j6| j8| j:| j<| j>| j@fzt0j3d tjj|jBd dtjj|d|jDr jG|jD  jId|jJ t0j3d|jz  jOt/j.| z }  jR| z} t0j3dtUjV| dtUjX| d|j|r|j|jy#tj$r} t| Yd} ~ d} ~ wwxYw#tjtLjf$r} t| Yd} ~ .d} ~ wwxYw#tj$r} t| Yd} ~ 'd} ~ wwxYw#tP$rtdYFwxYw)z=Copy an image to a block device or a regular file using bmap.z+--nobmap and --bmap cannot be used togetherz6--bmap-sig and --no-sig-verify cannot be used togetherzBthe bmap signature file was specified, but bmap file was not foundzblock device '%s'z file '%s'Nzbmaptool: info: %d%% copiedz(no bmap given, copy entire image to '%s'zFbmap file not found, please, use --nobmap option to flash without bmapzblock map format version %sz:%d blocks of size %d (%s), mapped %d blocks (%s or %.1f%%)zcopying image 'z' to z using bmap file ''Fzsynchronizing '%s'zinterrupted, exitingzcopying time: z, copying speed z/sec)-rrr$r\r[rrr?r'rr BmapBdevCopyr9r@basenamer]quietdebugr stderrisattystdoutset_progress_indicatortimerrO bmap_version blocks_cnt block_sizeimage_size_human mapped_cntmapped_size_humanmapped_percentr psplash_pipeset_psplash_pipecopy no_verifyrsyncKeyboardInterrupt mapped_sizer human_time human_size)rrrrprq image_sizerf_objdest_strwriterrB start_time copying_time copying_speeds r copy_commandrsi {{tyy?@ }}++JKKU LHIx9j. }}X S  "$) >1 2 % 12  KKM 99;+L&&,6MHH  ! !, /1G1G 1V X  NN OOG >>#Z 0  cNN ~~  cNN  *()*ss"A.OO4:"QP0O1 O,,O14#P- P("Q(P--Q0Q QQQQQ43Q4c@|jr t|jd}n t j d} t j |jd}|j|j |js>jdtjj|jj |j"k(rFt$j'd|j(d|jd t$j'd yy#t$r"}td|j|Yd}~d}~wwxYw#t$r}td|Yd}~1d}~wwxYw#t j$r}t|Yd}~d}~wwxYw) a Generate block map (AKA bmap) for an image. The idea is that while images files may generally be very large (e.g., 4GiB), they may nevertheless contain only little real data, e.g., 512MiB. This data are files, directories, file-system meta-data, partition table, etc. When copying the image to the target device, you do not have to copy all the 4GiB of data, you can copy only 512MiB of it, which is 4 times less, so copying should presumably be 4 times faster. The block map file is an XML file which contains a list of blocks which have to be copied to the target device. The other blocks are not used and there is no need to copy them. The XML file also contains some additional information like block size, image size, count of mapped blocks, etc. There are also many commentaries, so it is human-readable. The image has to be a sparse file. Generally, this means that when you generate this image file, you should start with a huge sparse file which contains a single hole spanning the entire file. Then you should partition it, write all the data (probably by means of loop-back mounting the image or parts of it), etc. The end result should be a sparse file where mapped areas represent useful parts of the image and holes represent useless parts of the image, which do not have to be copied when copying the image to the target device. ryz$cannot open the output file '%s': %sNz"cannot create a temporary file: %ssha256rzall z are mapped, no holes in 'rz:was the image handled incorrectly and holes were expanded?)outputr:rar$r_r|rrgenerate no_checksumr]rdr rr}rrrrror)rrrBcreators r create_commandr1sH6 {{ Q$++t,F B++D1F'' FHET---. ;; A 'W/// '' 5  ST 0' Q =t{{C P P Q  B ;S A A B   #sED#E=E4# E,E  E E1 E,,E14F FFc"tjtj}t j |d}|j ddddtzzd}|j d d d | d }|j ddd | |jdd}d|_ d}|jd|}|jtd}|j d|d}|j dd|d}|j dd | d}|jd |}|jtd!d"jtj z}|j d|d#}|j d$|d%}|j d&|d'}|j d(d | d)}|j d*|d+}|j d,d | d-}|j d.d | d/}|j d0||j#S)1z3A helper function which parses the input arguments.bmaptool) descriptionprogz --versionversionz %(prog)s z%s)actionrzbe quietz-qz--quiet store_true)rhelpzprint debugging informationz-dz--debugcommandscommand)titlerTz?generate bmap for an image file (which should be a sparse file)create)r)funczthe image to generate bmap forrz/the output file name (otherwise stdout is used)z-oz--outputz9do not generate the checksum for block ranges in the bmapz --no-checksumz+write an image to a block device using bmaprz9the image file to copy. Supported formats: uncompressed, z, z8the destination file or device node to copy the image torz the block map file for the imagez--bmapz!allow copying without a bmap filez--nobmapz,the detached GPG signature for the bmap filez --bmap-sigz%do not verify bmap file GPG signatruez--no-sig-verifyz-do not verify the data checksum while writingz --no-verifyz write progress to a psplash pipez--psplash-pipe)r modulesr2r5argparseArgumentParser add_argumentVERSIONadd_subparsersrequired add_parser set_defaultsrrrrSUPPORTED_COMPRESSION_TYPES parse_args)textparser subparsers parser_create parser_copys r parse_argumentsrjsY ;;x ( (D  $ $J GF I{TG^/K D i 4H )D i 4H&&Zi&HJJ MD))()>MN3 ,DwT2 =DtZd; GD|$O 9D''T':K,/ G--J DW40 FDV$/ .DXD1 /DZ 4H :D\5 3D.|$O ;D].MyFormatterz A custom formatter for logging messages. The reason we have it is to have different format for different log levels. Nctjj||||j|_dzdzzdz|jz|_y)zThe constructor.[z %(asctime)sz] [%(module)s,%(lineno)d] N)logging Formatterr._fmt _orig_fmt_dbg_fmt)r,fmtdatefmtesc_end esc_greens r r.z*setup_logger..MyFormatter.__init__sd    & &tS' :!YYDN / / ))  Mr%c|jtjk(r|j|_tj j ||}|j|_|S)zy The formatter which which simply prefixes all debugging messages with a time-stamp. )levelnorDEBUGrrrformatr)r,recordresults r rz(setup_logger..MyFormatter.formatsG ~~. MM &&--dF;FDIMr%r)r2r3r4r5r.r)rrsr MyFormatterrs   r%rERRORWARNINGrrOz$bmaptool: %(levelname)s: %(message)sz%H:%M:%SN)rr addLevelNamerrrINFOrsetLevel StreamHandlerr r setFormatter addHandler)loglevelesc_red esc_yellowr formatterwhererrs @@r setup_loggerr sGJIG!g''!J '(9G(CD *y*@7*JK 0 v.LLBJOI  ! !#** -E y!NN5r%ct}|jrtj}n-|jrtj }ntj }t||jr|jr td |j|y#t$rtjdtjtjdt!dd5}|D]}t#|j% dddn #1swYnxYwtjdt!dd5}|D]}t#|j% dddYy#1swYYyxYwwxYw) zScript entry point.z+--quiet and --debug cannot be used togetherzOut of memory!zThe contents of /proc/meminfo:z /proc/meminfortNz"The contents of /proc/self/status:z/proc/self/status)rrrrrrrr r$r MemoryErrorrrr print_excrOr:printr)rrr-rs r mainrs  D zz?? ==<< zzdjj?@$ $  $ "# 12 /4 (H djjl#!) ( ( 56 %t , djjl#!- , , $sCBAE;)!D E;D (E;!E-#E;-E7 2E;7E;__main__)&r5rr r9rrrr_r rbrgrrrrrrr getLoggerrr!r$objectr'rCrWrwrrrrrrrr rr2exitr6r%r rs"  :: g<--"%:6L^4n!IH: z@VFeP6UrQh:z$B z CHHTVr%