a d!a@sdZddlZddlZddlZddlZddlmZddlZddlm Z ddl m Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZddl mZddlmZddlmZdZdZdZ ddZ!d6ddZ"Gdddej#dZ$Gddde$Z%Gddde$Z&Gd d!d!e$Z'Gd"d#d#e$Z(d$d%Z)d&d'Z*Gd(d)d)e$Z+Gd*d+d+e$Z,d7d,d-Z-d.d/Z.d0d1Z/d2d3Z0Gd4d5d5ej1Z2dS)8z>Entry point and high-level logic for TensorBoard.dev uploader.N)logging)tf)experiment_pb2)export_service_pb2_grpc)write_service_pb2_grpc)auth) dry_run_stubs)exporter) flags_parser) formatters) server_info)uploader)server_info_pb2)program) base_pluginakYour use of this service is subject to Google's Terms of Service and Privacy Policy , and TensorBoard.dev's Terms of Service . This notice will not be shown again while you are logged into the uploader. To log out, run `tensorboard dev auth revoke`. diXcCsb|}d}d||tf}tj|tjdtd}|dvrRtdtjddS)z>Prompts for user consent, exiting the program if they decline.z" ***** TensorBoard Uploader *****  zContinue? (yes/NO) )yyesrN) get_ack_message_bodyjoin _MESSAGE_TOSsysstderrwriteinputlowerexit)intentbodyheaderZuser_ack_messageresponser"q/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/tensorboard/uploader/uploader_subcommand.py_prompt_for_user_ack;s    r$c Cs^ttjt||}t}t|trJ|t j dt j dS| }|st|tj|jd}t j d|||j\}}z t|}Wn2tjy}ztt|WYd}~n d}~00t|td||jjstd|tdt|t |} tj!|jj| |d} | |"|| Wdn1sP0YdS) zRuns the main uploader program given parsed flags. Args: flags: An `argparse.Namespace`. experiment_url_callback: A function accepting a single string argument containing the full TB.dev URL of the uploaded experiment. zLogged out of uploader. N)Z force_consolerzReceived server info: <%r>zServer info response: %sz6Internal error: frontend did not specify an API server)options)#rZset_stderrthresholdWARNING _get_intentrZCredentialsStore isinstance_AuthRevokeIntentclearrrrflushZread_credentialsr$Zauthenticate_userZauth_force_consoleZwrite_credentialsZgrpc_creds_typeZchannel_config_get_server_infoserver_info_libZCommunicationError_diestr_handle_server_infoinfo api_serverendpointerrorgrpcZcomposite_channel_credentialsZid_token_call_credentialsZsecure_channelexecute) flagsexperiment_url_callbackrstore credentialsZ channel_credsZchannel_optionsr eZcomposite_channel_credschannelr"r"r#_runHsH        "    r=c@s,eZdZdZejddZejddZdS)_IntentzA description of the user's intent in invoking this program. Each valid set of CLI flags corresponds to one intent: e.g., "upload data from this logdir", or "delete the experiment with that ID". cCsdS)zGets the message to show when executing this intent at first login. This need not include the header (program name) or Terms of Service notice. Returns: A Unicode string, potentially spanning multiple lines. Nr"selfr"r"r#rs z_Intent.get_ack_message_bodycCsdS)aCarries out this intent with the specified gRPC channel. Args: server_info: A `server_info_pb2.ServerInfoResponse` value. channel: A connected gRPC channel whose server provides the TensorBoard reader and writer services. Nr"r@r r<r"r"r#r6s z_Intent.executeN)__name__ __module__ __qualname____doc__abcabstractmethodrr6r"r"r"r#r>s  r>) metaclassc@s eZdZdZddZddZdS)r)z'The user intends to revoke credentials.cCs tddS)zMust not be called.z(No user ack needed to revoke credentialsNAssertionErrorr?r"r"r#rsz&_AuthRevokeIntent.get_ack_message_bodycCs tddS)zJExecute handled specially by `main`. Must not be called. z1_AuthRevokeIntent should not be directly executedNrIrAr"r"r#r6sz_AuthRevokeIntent.executeN)rBrCrDrErr6r"r"r"r#r)sr)c@s2eZdZdZedZddZddZddZ d S) _DeleteExperimentIntentz)The user intends to delete an experiment.aA This will delete the {num} experiment(s) on https://tensorboard.dev with the following experiment ID(s): {experiment_id_list} You have chosen to delete an experiment. All experiments uploaded to TensorBoard.dev are publicly visible. Do not upload sensitive data. cCs ||_dSN)experiment_id_list)r@rMr"r"r#__init__sz _DeleteExperimentIntent.__init__cCs|jjt|j|jdS)N)numrM)_MESSAGE_TEMPLATEformatlenrMr?r"r"r#rsz,_DeleteExperimentIntent.get_ack_message_bodyc Cs>t|}|jstdi}d}d}t|jD]}|sFd|f||<q0z t||d||f||<Wq0tjyd||f||<Yq0tj yd||f||<Yq0t j y}z d||f|f||<WYd}~q0d}~00q0d } d } | D]2\} } | |krt | | |kr| | d 7} d } q| r:t| dS) Nz2Must specify at least one experiment ID to delete. NO_ACTION DIE_ACTIONzSkipping empty experiment_id.zDeleted experiment %s.NNo such experiment %s. Either it never existed or it has already been deleted.zDCannot delete experiment %s because it is owned by a different user.z*Internal error deleting experiment %s: %s.FrT)rTensorBoardWriterServiceStubrMr FlagsErrorset uploader_libZdelete_experimentExperimentNotFoundErrorPermissionDeniedErrorr5RpcErrorvaluesprintr.) r@r r< api_clientresultsrSrT experiment_idr;Zany_die_actionerr_msgmsgactionr"r"r#r6sb       z_DeleteExperimentIntent.executeN rBrCrDrEtextwrapdedentrPrNrr6r"r"r"r#rKs rKc@s4eZdZdZedZd ddZddZdd Z dS) _UpdateMetadataIntentz:The user intends to update the metadata for an experiment.aM This will modify the metadata associated with the experiment on https://tensorboard.dev with the following experiment ID: {experiment_id} You have chosen to modify an experiment. All experiments uploaded to TensorBoard.dev are publicly visible. Do not upload sensitive data. NcCs||_||_||_dSrL)rbname description)r@rbrjrkr"r"r#rNsz_UpdateMetadataIntent.__init__cCs|jj|jdS)N)rb)rPrQrbr?r"r"r#rsz*_UpdateMetadataIntent.get_ack_message_bodyc Cs4t|}|j}t|jt|j|s2tdzt j |||j|jdWnt j ylt d|Ynt j yt d|Ynbt jy}zt d|WYd}~n:d}~0tjy}zt d|WYd}~n d}~00td||jdurtd|j|jdur0td t|jdS) Nz1Must specify a non-empty experiment ID to modify.rjrkrUzDCannot modify experiment %s because it is owned by a different user.z0Server cannot modify experiment as requested: %sz'Internal error modifying experiment: %szModified experiment %s.zSet name to %rzSet description to %r)rrWrb_die_if_bad_experiment_namerj"_die_if_bad_experiment_descriptionrkrrXrZZupdate_experiment_metadatar[r.r\ZInvalidArgumentErrorr5r]rr1repr)r@r r<r`rbr;r"r"r#r6sL    "   z_UpdateMetadataIntent.execute)NNrfr"r"r"r#ris ric@s4eZdZdZedZd ddZddZdd Z dS) _ListIntentz/The user intends to list all their experiments.z This will list all experiments that you've uploaded to https://tensorboard.dev. TensorBoard.dev experiments are visible to everyone. Do not upload sensitive data. NcCs ||_dS)zConstructor of _ListIntent. Args: json: If and only if `True`, will print the list as pretty-formatted JSON objects, one object for each experiment. Njson)r@rrr"r"r#rNLsz_ListIntent.__init__cCs|jSrL)_MESSAGEr?r"r"r#rUsz _ListIntent.get_ack_message_bodyc Cst|}tjdddddddddd }tj||d}d}|jrHt}nt }|D].}|d7}|j } t || } t ||| qTtj|stjdntjd|tjdS)NT) rjrkZ create_timeZ update_timeZnum_runsZnum_tagsZ num_scalarsZtotal_tensor_bytesZtotal_blob_bytes) fieldmaskrz=No experiments. Use `tensorboard dev upload` to get started. zTotal: %d experiment(s) )rTensorBoardExporterServiceStubrZExperimentMask exporter_libZlist_experimentsrrr Z JsonFormatterZReadableFormatterrbr-experiment_urlr_Zformat_experimentrstdoutr+rr) r@r r<r`rtgencount formatterZ experimentrburlr"r"r#r6Xs>    z_ListIntent.execute)N) rBrCrDrErgrhrsrNrr6r"r"r"r#rpAs rpcCs$|r t|tkr tdt|fdS)NzFExperiment name is too long. Limit is %s characters. %r was provided.)rR_EXPERIMENT_NAME_MAX_CHARSr.)rjr"r"r#rm}s rmcCs$|r t|tkr tdt|fdS)NzMExperiment description is too long. Limit is %s characters. %r was provided.)rR!_EXPERIMENT_DESCRIPTION_MAX_CHARSr.)rkr"r"r#rns rnc@s4eZdZdZedZd ddZddZdd Z dS) UploadIntentz?The user intends to upload an experiment from the given logdir.z This will upload your TensorBoard logs to https://tensorboard.dev/ from the following directory: {logdir} This TensorBoard will be visible to everyone. Do not upload sensitive data. NcCsF||_||_||_||_|dur$dn||_|dur6dn||_||_dS)NF)logdirrjrk verbositydry_runone_shotr8)r@rrjrkrrrr8r"r"r#rNs zUploadIntent.__init__cCs|jj|jdS)N)r)rPrQrr?r"r"r#rsz!UploadIntent.get_ack_message_bodyc Cs|jrt}n t|}t|jt|jt j ||j t |t ||j|j|j|jd}|jrtjj|j std|j tddS|}t ||}|jdur|||jstd|jrtdn td|d}z>z |Wnt jytdYW|jr8|s8td |j |jfd }|rL|d 7}n|d 7}|jsr|rr|d |7}tj|dtj dSt!yd}Yn0W|jr|std |j |jfd }|r|d 7}n|d 7}|js |r |d |7}tj|dtj n||jrL|sLtd |j |jfd }|r`|d 7}n|d 7}|js|r|d |7}tj|dtj 0dS)N)allowed_plugins upload_limitsrjrkrrz%s: No such directory.zbUser specified `one_shot` mode with an unavailable logdir. Exiting without creating an experiment.ztUpload started and will continue reading any new data as it's added to the logdir. To stop uploading, press Ctrl-C.zC ** This is a dry run. No data will be sent to tensorboard.dev. ** z6 New experiment created. View your TensorBoard at: %s Fz4Experiment was deleted; uploading has been cancelledzTensorBoard was run in `one_shot` mode, but did not find any uploadable data in the specified logdir: %s An empty experiment was created. To delete the empty experiment you can execute the following tensorboard dev delete --experiment_id=%sz z Interrupted.zDone.z View your TensorBoard at %srT)"rrZDryRunTensorBoardWriterStubrrWrmrjrnrkrZZTensorBoardUploaderrr-rrrrrioZgfileisdirr_Zcreate_experimentrxr8Zstart_uploadingr[has_datarbrryrr+KeyboardInterrupt) r@r r<r`r rbr} interruptedZ end_messager"r"r#r6s                       zUploadIntent.execute)NNNNNNrfr"r"r"r#rs rc@s2eZdZdZedZddZddZddZ d S) _ExportIntentz7The user intends to download all their experiment data.a^ This will download all your experiment data from https://tensorboard.dev and save it to the following directory: {output_dir} Downloading your experiment data does not delete it from the service. All experiments uploaded to TensorBoard.dev are publicly visible. Do not upload sensitive data. cCs ||_dSrL output_dir)r@rr"r"r#rNsz_ExportIntent.__init__cCs|jj|jdS)Nr)rPrQrr?r"r"r#rsz"_ExportIntent.get_ack_message_bodyc Cst|}|j}zt||}Wn&tjyFd|}t|Yn0d}z&|D]}|d7}t d|qVWn4tj y} zt d| j WYd} ~ n d} ~ 00t d||fdS)Nz#Output directory already exists: %rrruzDownloaded experiment %sz Uploader has failed because of a timeout error. Please reach out via e-mail to tensorboard.dev-support@google.com to get help completing your export of experiment %s.z&Done. Downloaded %d experiments to: %s) rrvrrwZTensorBoardExporterZOutputDirectoryExistsErrorrrXexportr_ZGrpcTimeoutExceptionrb) r@r r<r`outdirr rdZnum_experimentsrbr;r"r"r#r6s.  z_ExportIntent.executeNrfr"r"r"r#rs rc Cs|t|tjd}|dur td|tjkrd|jrZttj |j|j |j |j |j|j|dStd|tjkr|jr|j dus|j durt|j|j |j dStdn tdn|tjkr|jrt|jStdn|tjkrt|jd S|tjkr|jrt|jStd n^|tjkrjt|tjd}|durHtd |tjkrZtStd |fntd |fdS)aDetermines what the program should do (upload, delete, ...). Args: flags: An `argparse.Namespace` with the parsed flags. experiment_url_callback: A function accepting a single string argument containing the full TB.dev URL of the uploaded experiment. Returns: An `_Intent` instance. Raises: base_plugin.FlagsError: If the command-line `flags` do not correctly specify an intent. Nz%Must specify subcommand (try --help).)rjrkrrrr8z0Must specify directory to upload via `--logdir`.rlz0Must specify either `--name` or `--description`.z8Must specify experiment to modify via `--experiment_id`.z;Must specify experiment(s) to delete via `--experiment_id`.rqz-Must specify output directory via `--outdir`.z$Must specify a subcommand to `auth`.zUnknown auth subcommand %rzUnknown subcommand %r) getattrr ZSUBCOMMAND_FLAGrrXZSUBCOMMAND_KEY_UPLOADrrospath expanduserrjrkverboserrZSUBCOMMAND_KEY_UPDATE_METADATArbriZSUBCOMMAND_KEY_DELETErKZSUBCOMMAND_KEY_LISTrprrZSUBCOMMAND_KEY_EXPORTrrZSUBCOMMAND_KEY_AUTHZAUTH_SUBCOMMAND_FLAGZAUTH_SUBCOMMAND_KEY_REVOKEr)rJ)r7r8cmdZauth_cmdr"r"r#r'/sj               r'cCs\|jp tj}t|dg}|jr4|js4t||j|St||}|jrX|jj rX|j|j_ |S)Nplugins) originr ZDEFAULT_ORIGINrZ api_endpointr-Zcreate_server_infoZfetch_server_infor2r3)r7rrr r"r"r#r,|s     r,cCsr|j}|jtjkr0tjd|jtjn>|jtj krLt d|jn"|jrntjd|jtjdS)NzWarning [from server]: %s zError [from server]: %s%s ) Z compatibilityZverdictrZ VERDICT_WARNrrrdetailsr+Z VERDICT_ERRORr.)r1compatr"r"r#r0s   r0cCs*tjd|ftjtddS)Nrru)rrrr+r)messager"r"r#r.s r.c@s:eZdZdZd ddZddZddZd d Zd d ZdS)UploaderSubcommandz)Integration point with `tensorboard` CLI.NcCs ||_dS)zConstructor of UploaderSubcommand. Args: experiment_url_callback: A function accepting a single string argument containing the full TB.dev URL of the uploaded experiment. N)_experiment_url_callback)r@r8r"r"r#rNszUploaderSubcommand.__init__cCsdS)Ndevr"r?r"r"r#rjszUploaderSubcommand.namecCst|dSrL)r define_flags)r@parserr"r"r#rszUploaderSubcommand.define_flagscCs t||jSrL)r=r)r@r7r"r"r#runszUploaderSubcommand.runcCsdS)Nzupload data to TensorBoard.devr"r?r"r"r#helpszUploaderSubcommand.help)N) rBrCrDrErNrjrrrr"r"r"r#rs  r)N)N)3rErFrrrgZabslrr5Ztensorboard.compatrZtensorboard.uploader.protorrrZtensorboard.uploaderrrr rwr r r r-r rZrZ tensorboardrZtensorboard.pluginsrrr~rr$r=ABCMetar>r)rKrirprmrnrrr'r,r0r.ZTensorBoardSubcommandrr"r"r"r#sN                 7S?<  p0 M