a V$cp@sddlmZmZmZmZmZddlmZmZm Z m Z m Z m Z m Z mZmZmZmZmZddlZddlZddlZddlZddlZddlZddlZddlZddlmZmZddlZejZdZ erddl!Z!e!"Z#e#d7Z#nddl$m%Z#e#d7Z#d Z&d Z'Gd d d e(Z)d dZ*Gddde+Z,dS))divisionabsolute_importwith_statementprint_functionunicode_literals) PY2 basestringbchrbordchropenpystrrangeroundstrtobytesunicodeN)loadsdumpss_v2.1) MAGIC_NUMBERs_v3.1s RENPY RPC2zcache/bytecode.rpybc@seZdZdZdS) ScriptErrorza Exception that is raised if the script is somehow inconsistent, or otherwise wrong. N)__name__ __module__ __qualname____doc__rrrenpy/script.pyrFsrcCsg}|D]}||jq|S)zO Returns a flat list containing every statement in the tree stmts. ) get_childrenappend)stmtsrvirrrcollapse_stmtsMsr#c@seZdZdZddZddZddZdd Zd d Zd d Z ddZ ddZ d7ddZ d8ddZ ddZddZddZdd Zd!d"Zd#d$Zd%d&Zd'd(Zd)d*Zd+d,Zd-d.Zd/d0Zd1d2Zd3d4Zd5d6ZdS)9Scriptak This class represents a Ren'Py script, which is parsed out of a collection of script files. Once parsing and initial analysis is complete, this object can be serialized out and loaded back in, so it shouldn't change at all after that has happened. @ivar namemap: A map from the name of an AST node to the AST node itself. This is used for jumps, calls, and to find the current node when loading back in a save. The names may be strings or integers, strings being explicit names provided by the user, and integers being names synthesised by renpy. @ivar initcode: A list of priority, Node tuples that should be executed in ascending priority order at init time. @ivar all_stmts: A list of all statements, that have been found in every file. Useful for lint, but tossed if lint is not performed to save memory. cCs|tj_tjtjjdr6ttjjdd |_ nd|_ i|_ g|_ g|_ g|_g|_d|_i|_i|_d|_tj|_|||jd|_ttjd|_d|_ g|_!g|_"dS)z Loads the script by parsing all of the given files, and then walking the various ASTs to initialize this Script object. z /lock.txtrbNTFrzutf-8)#renpygamescriptospathexistsconfig renpy_baser readkeynamemap all_stmts all_pycode all_pyexpr need_analysis record_pycodebytecode_oldcachebytecode_newcachebytecode_dirty translationScriptTranslator translator init_bytecodescan_script_fileschain_translatesserialhashlibmd5 version_onlyencodedigest loaded_rpy backup_listduplicate_labelsselfrrr__init__qs,  zScript.__init__cCstjr dSdD]}tj|rdSqddl}|tjjd}|durJdStj tjj }tjj tj |tj |}tj d||S)N)zscript_version.txtzscript_version.rpyzscript_version.rpycrbackupszBacking up script files to %r:)r&mobileloaderloadable__main__ path_to_savesr,gamedirr)r*basenamebasedirjoinexportsfsencode write_log)rIr"rOrKrR backupdirrrrchoose_backupdirs  zScript.choose_backupdirc CsN|j}g|_tjdddkr"dS|js,dStjr6dS|}|durJdS|D]\}}|tj j sfqNtj |stqNtj |ttj j dd}tj |\}}tr|ddd}n|dd}tj ||d||} tj | rqNzttj | dWnty Yn0zt|| WqNtyFYqN0qNdS) NRENPY_DISABLE_BACKUPSzI take responsibility for this.rhex.i)rFr)environgetrEr&rLrY startswithr,rQr*r+rUrVlensplitextrrCr]rTmakedirsdirname Exceptionshutilcopy) rIrFrXfnchecksumshort_fnbaseext hex_checksum target_fnrrr make_backupssF    zScript.make_backupscCstj}g|_g|_|D]\}}|drJ|dur6q|dd}|j}nf|drh|dd}|j}nH|dr|dur|q|dd}|j}n |dr|dd}|j}nq||f|vr|||fqdS) z8 Scan the directories for script files. .rpyN.rpyc.rpym.rpymci)r&rM listdirfiles script_files module_filesendswithr)rIdirlistdirritargetrrrr=s.           zScript.scan_script_filescCs|j}|jdddg}|D]>\}}tjr>ddl}|dtjj|dd|||qddt |D}|jd ddd d|D|_ |j dS) NcSs|dp d|dpdfS)Nrr[rr)itemrrrz$Script.load_script..)r/rrsrqcSsg|]\}\}}|||fqSrr).0indexpriocoderrr ,rz&Script.load_script..cSs|d|dfS)Nrrr)r"rrrr/rcSsg|]\}}}||fqSrr)rrrrrrrr1r) rxsortr& emscriptensleepdisplay presplash pump_windowload_appropriate_file enumerateinitcoder;r>)rIrxrrir|rrrr load_scripts   zScript.load_scriptcs~fdd|jD}|s$tdt|dkr.zModule %s could not be loaded.z-Module %s ambiguous, multiple variants exist.rrvru) ryrfrbrr&parserreport_parse_errors SystemExitr;r>)rIrfilesrir|rrrr load_module5s      zScript.load_modulecCsHt|}tt}|D]*}|jdur|||jf|_|jd7_qdS)Nr)r#inttimerr?)rIr rir1versionsrrr assign_namesKs   zScript.assign_namesc Cst|}t|}dd|D}dd|D}td||}|D]X\}}} t| D]D} ||| } ||| } | jdurT| j|vrT| j| _|| jqTqBdS)NcSsg|] }|qSr diff_inforr"rrrr\rz&Script.merge_names..cSsg|] }|qSrrrrrrr]r)r#difflibSequenceMatcherget_matching_blocksrradd) rI old_stmts new_stmts used_namesold_infonew_infosmoldlnewlcountr"oldnewrrr merge_namesWs   zScript.merge_namesrcCsNtjj|||d}|durdS|||||g}|||d}||fS)a9 Loads Ren'Py script from a string. `filename` The filename that's assigned to the data. `filedata` A unicode string to be loaded. Return the list of statements making up the root block, and a list of init statements that need to be run. ) linenumberNNNF)r&rparserstatic_transforms finish_load)rIfilenamefiledatarr rrrr load_stringjs  zScript.load_stringTNc sL|s|Stj|dg}|D]}||jq|D],}t|tjjr4|jdkr4tjj |j q4j ||durtj|}|dj |s|ddkr|d7}|D] }||_ qfdd}|D]J}|j} |||j| <|jr|} | r|| |jr|q؈jdur<j|j||S)a Given `stmts`, a list of AST nodes comprising the root block, finishes loading it. `initcode` A list we append init statements to. `check_names` If true, produce duplicate name errors. `filename` If given, a filename that overrides the filename found inside the file. Returns a list of statements that corresponds to the top-level block in initcode after transformation. N)python3rrccssdStjrdSd}d}d}|j}|jvr|}|}j|}t|tsntdt||j|j |j|j fnNtj j rzdSj d||j|j tj|j|j |j|j tj|j|j dS)Nz-Name %s is defined twice, at %s:%d and %s:%d.zRThe label {} is defined twice, at File "{}", line {}: {}and File "{}", line {}: {})r&rLrr0 isinstancerrreprrrr,allow_duplicate_labelsrGrformatr get_line_text)nodebad_namebad_nodeold_noder check_namesrIrr check_names:    z&Script.finish_load..check_name)r&ast chain_blockrrrRPYrestr py3_filesrrr;take_translatesrelide_filenamelowerrzupdate_bytecoderr0get_init early_executer1extendr4) rIr rrrr1r"rrrinitrrrrsB   (      zScript.finish_loadc Cs2|ttdD]}|tddddqdS)zU Writes an empty version 2 .rpyc header to the open binary file `f`. IIIrN)write RPYC2_HEADERrstructpack)rIf_irrrwrite_rpyc_headers  zScript.write_rpyc_headerc Csp|dd|}t|d}|||ttd|dd|td||t||dddS)z Writes data into `slot` of a .rpyc file. The data should be a binary string, and is compressed before being written. rrr rrN) seektellzlibcompressrrbrrr)rIrslotdatastartrrrwrite_rpyc_datas   zScript.write_rpyc_datacCs|dd||dS)z< Writes the md5 to the end of a .rpyc file. rrN)rr)rIrrDrrrwrite_rpyc_md5s zScript.write_rpyc_md5c Cs|d}|dtttkrF|dkr*dS|d|}t|Stt}td|||d\}}}||krvq|dkrdS|d7}qN||||}t|S)z Reads the binary data from `slot` in a .rpyc (v1 or v2) file. Returns the data if the slot exists, or None if the slot does not exist. iNrrrr)r.rbrrr decompressrunpack) rIrr header_datarpos header_slotrlengthrrrread_rpyc_datas"      zScript.read_rpyc_datacCstj|dS)z This performs transformations on the script that can be performed statically. When possible, these transforms are stored in slot 2 of the rpyc file. N)r&r9 restructure)rIr rrrrGszScript.static_transformsc Cs|ds|drP|s&td||d\}}}|d|}|d|}|d}|d|d} tj|} i} t| d<|jpd| d <| dur| gfSt} | |fD]} zzhd |_ t | d }| |d }Wdn1s0Y|durt |\}}| || | ~~Wnty,Yn0Wd |_ qd |_ 0q|| tj|t| | f}|| t| | f}tjsFzt |d}||||d |||d|t |d "}t|}Wdn1s0Y|||Wdn1s0YWn$tyDddl}|Yn0d |_nZ|dsh|drd} d} tj|}dD]P}z*| ||}|rt |\} } WqWntyYn0|dqWddS| dur t d|WddSt!| t"s&WddS|jrR| #d d|jkrRWddS| dtkrpWddS|dkr|| Wdn1s0YndS| | fS)Nrqruz4Cannot load rpy/rpym file %s from inside an archive./z/old-rrunlockedr/Fr%rTwbrrrsrv)rrrzFailed to load)$rzrf rpartitionr&rrscript_versionr/setr5r rrrrrrrmacapprrr@rAr.rDr traceback print_excrErMloadrprintrdictr`)rIr|rirl_r'olddirfullfnrpycfn oldrpycfnr rrmergefnrpycfbindataold_datar$pickle_data_before_static_transforms#pickle_data_after_static_transformsrfullf rpydigestrrrrr load_fileQs      *        20        ,zScript.load_filecCsZd}|dur||}||}||||\}} |durFtd|ftj||4} | tj d| tj} Wdn1s0YnR|d||}|d||} tj |t j |rt|d"} t| } Wdn1s 0Ynd} zht j | r~t| d4} | tj d| tj}Wdn1sr0Ynd}Wntyd}Yn0d} t j |rt j | rtjjj}|}d\}} z>| |kr|s||||\}} |durtd| WnHtyZtjjd| tjjdt jvrVtd | Yn0|durz||||\}} | } nVt j | r| }||||\}} |} n*t j |r|}||||\}} | } | dur|j|| f|durtd ||jdur|d |_n|j|d kr:t|d |j| ||d |j| dS)NzCould not load from archive %s.rrr%rzCould not load zWhile loading %rRENPY_RPYC_EXCEPTIONSz While loadingzCould not load file %s.r/z{ does not share a key with at least one .rpyc file. To fix, delete all .rpyc files, or rerun Ren'Py with the --lock option.)r)r rfr&rMrrr@rA digest_sizer.add_autor)r*r+r rDr'argscompilerrlogr exceptionr_rFrr/rupdate)rIcompiledsourcer|rirrrpyfnlastfnr rrDrr rpycdigest force_compilerrrrs|2  4 2             zScript.load_appropriate_filecCslzTtjt4}tt|\}}|tkr4||_ Wdn1sH0YWnt yfYn0dS)z0 Init/Loads the bytecode cache. N) r&rMr BYTECODE_FILErrrr.BYTECODE_VERSIONr6rf)rIrrcacherrrr<-s( zScript.init_bytecodec Cs|jD]*}ztj|dWqty.Yq0qg|_|jD]}|t}|jdtjj vrj|d7}|j |d}|durd|_ tj j}d|jd|jdftj _z|jdkrtjj|j|jd|jd|jd }nb|jd krtjj|j|jd|jd|jd }n0|jdkr@tjj|j|jd|jd|jd }Wntty}zZ|j}|durhd }tjj|j|j|j||jd }tjj|jWYd}~q>WYd}~n d}~00|tj _||j |<t!"||_#q>g|_dS) zy Compiles the PyCode objects in self.all_pycode, updating the cache. Clears out self.all_pycode. evalrs_py3NTz7While compiling python block starting at line %d of %s.rexec)rlinenopyhider[)rnumbermsgliner)$r3r&r py_compilerfr2get_hashMAGIClocationrr6r`r8r'exception_infomodepy_compile_exec_bytecoderrpy_compile_hide_bytecodepy_compile_eval_bytecode SyntaxErrortextr ParseErrorrrr!offset parse_errorsrmessager7marshalrbytecode)rIr"r/rold_eier-pemrrrr<sN      & & ( " zScript.update_bytecodecCstjr dS|jr~zZtjt}t|d0}t|jf}| t t |dWdn1s^0YWnt y|Yn0dS)Nrr)r&rr8rMget_pathrr rr7rrrrrf)rIrirrrrr save_bytecode~s   8 zScript.save_bytecodecCst|tjjr|jdj}tjj||}|}|j |d}|durjtjj durjtj |}|j |d}|durt dt ||j |S)zp Looks up the given label in the game. If the label is not found, raises a ScriptError. rNzcould not find label '%s'.) rr&rSubParseblockrr,label_overridesr`r0missing_label_callbackrr)rIlabeloriginalr!rrrlookups  z Script.lookupcCs>t|tjjr$|jsdS|jdj}tjj||}||j vS)zG Returns true if the label exists, or false otherwise. Fr) rr&rr9r:rr,r;r`r0rIr=rrr has_labels  zScript.has_labelcCs$|dur dS||sdS||S)zR Looks up the label if it exists, or returns None if it does not. N)rAr?r@rrrlookup_or_nones  zScript.lookup_or_nonecCs|jD] }|qg|_dS)z= Analyzes all statements that need analysis. N)r4analyze)rIr"rrrrCs  zScript.analyzecCs8tjjs dStjjrdS|jtj_tjr4tddS)Nr) r&r, developerignore_duplicate_labelsrGrr0rrrHrrrreport_duplicate_labelss  zScript.report_duplicate_labels)r)TN)rrrrrJrYrpr=rrrrrrrrrrrr rr<rr8r?rArBrCrFrrrrr$[s4.5)!   v ( siB  r$)- __future__rrrrr renpy.compatrrr r r r r rrrrrr&r@r)rrr2rrrenpy.compat.picklerrrgrrimp get_magicr%Zimportlib.utilrrrrfrr#objectr$rrrrs08