U 8b,@sdZddlmZddlmZddlmZddlmZddl m Z ddl Z ddl Z ddl Z ddlmZdd lmZdd lmZdd lmZGd d d eZGdddeZGddde jZGdddeZddZddZdS)zyBatch updates / deletes of storage buckets / blobs. See https://cloud.google.com/storage/docs/json_api/v1/how-tos/batch ) encode_noop) Generator)MIMEApplication) MIMEMultipart)ParserN)_helpers) exceptions) Connection)_DEFAULT_TIMEOUTcs eZdZdZfddZZS)MIMEApplicationHTTPa?MIME type for ``application/http``. Constructs payload from headers and body :type method: str :param method: HTTP method :type uri: str :param uri: URI for HTTP request :type headers: dict :param headers: HTTP headers :type body: str :param body: (Optional) HTTP payload cst|tr(t|}d|d<t||d<|dkr4d}d||fg}|ddt|D|d||d |}t |d t dS) Nzapplication/jsonz Content-TypezContent-Lengthz%s %s HTTP/1.1cSsg|]\}}d||fqS)z%s: %s).0keyvaluer r S/var/www/flask_sites/venv/lib/python3.8/site-packages/google/cloud/storage/batch.py >sz0MIMEApplicationHTTP.__init__..z http) isinstancedictjsondumpslenextendsorteditemsappendjoinsuper__init__r)selfmethoduriheadersbodylinespayload __class__r rr5s      zMIMEApplicationHTTP.__init__)__name__ __module__ __qualname____doc__r __classcell__r r r'rr "sr c@s.eZdZdZed ddZddZddZdS) _FutureDictzvClass to hold a future value for a deferred request. Used by for requests that get sent in a :class:`Batch`. NcCstd||fdS)a,Stand-in for dict.get. :type key: object :param key: Hashable dictionary key. :type default: object :param default: Fallback value to dict.get. :raises: :class:`KeyError` always since the future is intended to fail as a dictionary. z&Cannot get(%r, default=%r) on a futureNKeyError)rdefaultr r rgetLs z_FutureDict.getcCstd|fdS)zStand-in for dict[key]. :type key: object :param key: Hashable dictionary key. :raises: :class:`KeyError` always since the future is intended to fail as a dictionary. z Cannot get item %r from a futureNr/)r rr r r __getitem__[s z_FutureDict.__getitem__cCstd||fdS)a'Stand-in for dict[key] = value. :type key: object :param key: Hashable dictionary key. :type value: object :param value: Dictionary value. :raises: :class:`KeyError` always since the future is intended to fail as a dictionary. zCannot set %r -> %r on a futureNr/)r rrr r r __setitem__fs z_FutureDict.__setitem__)N)r)r*r+r, staticmethodr2r3r4r r r rr.Fs   r.cs4eZdZdZfddZddZeddZZS)_FutureResponsezEReponse that returns a placeholder dictionary for a batched requests.cstt|||_d|_dS)N)rr6r _future_dict status_code)r Z future_dictr'r rrxsz_FutureResponse.__init__cCs|jSNr8r r r rr}sz_FutureResponse.jsoncCs|jSr:r;r<r r rcontentsz_FutureResponse.content) r)r*r+r,rrpropertyr=r-r r r'rr6us  r6cs`eZdZdZdZfddZefddZddZd d Z d d Z d dZ ddZ ddZ ZS)BatchzProxy an underlying connection, batching up change operations. :type client: :class:`google.cloud.storage.client.Client` :param client: The client to use for making connections. ics6|jj}|jj}tt|j|||dg|_g|_dS)N) client_info api_endpoint) _connection API_BASE_URLZ _client_inforr?r _requests_target_objects)r clientrAr@r'r rrs zBatch.__init__cCs\t|j|jkrtd|j|j|||||ft}|j||dk rT||_t|S)auOverride Connection: defer actual HTTP request. Only allow up to ``_MAX_BATCH_SIZE`` requests to be deferred. :type method: str :param method: The HTTP method to use in the request. :type url: str :param url: The URL to send the request to. :type headers: dict :param headers: A dictionary of HTTP headers to send with the request. :type data: str :param data: The data to send as the body of the request. :type target_object: object :param target_object: (Optional) This allows us to enable custom behavior in our batch connection. Here we defer an HTTP request and complete initialization of the object at a later time. :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :rtype: tuple of ``response`` (a dictionary of sorts) and ``content`` (a string). :returns: The HTTP response object and the content of the response. z#Too many deferred requests (max %d)N) rrD_MAX_BATCH_SIZE ValueErrorrr.rE _propertiesr6)r r!urlr#data target_objecttimeoutresultr r r _do_requests" zBatch._do_requestc Cst|jdkrtdt}t}|jD]*\}}}}}t||||}|||}q&t} t | dd} | || } | dd\} }t |j||fS)zPrepares headers and body for a batch request. :rtype: tuple (dict, str) :returns: The pair of headers and body of the batch request to be sent. :raises: :class:`ValueError` if no requests have been deferred. rzNo deferred requestsFz )rrDrHrr r attachioStringIOrflattengetvaluesplitr_headers) r ZmultirMr!r"r#r$_timeout subrequestbuf generatorr&_r r r_prepare_batch_requests   zBatch._prepare_batch_requestc Csd}t|jt|krtdt|j|D]^\}}d|jkrHdksTn|pP|}q*|dk r*z||_Wq*tk r|j|_Yq*Xq*|dk rt |dS)a6Apply all the batch responses to the futures created. :type responses: list of (headers, payload) tuples. :param responses: List of headers and payloads from each response in the batch. :raises: :class:`ValueError` if no requests have been deferred. Nz&Expected a response for every request.,) rrErHzipr9rrIr=rfrom_http_response)r responsesZexception_argsrL subresponser r r_finish_futuress  zBatch._finish_futurescCsl|\}}}d|j}|jjjd||||d}d|jkrFdksRnt|tt |}| ||S)zSubmit a single `multipart/mixed` request with deferred requests. :rtype: list of tuples :returns: one ``(headers, payload)`` tuple per deferred request. z%s/batch/storage/v1POST)rKr#rMr^r_) r]rC_clientZ_base_connection _make_requestr9rralist_unpack_batch_responserd)r r#r$rMrJresponserbr r rfinishs    z Batch.finishcCs|jjS)z"Return the topmost batch, or None.)rfZ current_batchr<r r rcurrentsz Batch.currentcCs|j||Sr:)rfZ _push_batchr<r r r __enter__s zBatch.__enter__cCs&z|dkr|W5|jXdSr:)rfZ _pop_batchrk)r exc_typeexc_valexc_tbr r r__exit__s zBatch.__exit__)r)r*r+r,rGrr rOr]rdrkrlrmrqr-r r r'rr?s  -r?cCs8t|jdd}dd|d|jg}||dS)zdConvert response, content -> (multipart) email.message. Helper for _unpack_batch_response. z content-typer sContent-Type: s MIME-Version: 1.0 utf-8)r _to_bytesr#r2rr=parsestrdecode)parserrj content_typeZ faux_messager r r_generate_faux_mime_message%s  ryc cst}t||}t|jts$td|jD]}|jdd\}}|dd\}}}||}|j} t|j } | d} t } t j dd| d | _t|| _| j| | d | _| Vq*d S) a Convert requests.Response -> [(headers, payload)]. Creates a generator of tuples of emulating the responses to :meth:`requests.Session.request`. :type response: :class:`requests.Response` :param response: HTTP response / headers from a request. zBad response: not multi-part rP z Content-IDZBATCHzcontentid://{})r!rJrsN)rryr_payloadrhrHrVrurrWr2requestsResponseRequestformatpreparerequestintr9r#updateencode_content) rjrwmessagerYZ status_linerestr\statusZ sub_messager&Z msg_headersZ content_idrcr r rri6s(           ri)r,email.encodersremail.generatorrZemail.mime.applicationrZemail.mime.multipartr email.parserrrRrr~Z google.cloudrrZgoogle.cloud.storage._httpr Zgoogle.cloud.storage.constantsr r objectr.rr6r?ryrir r r rs&         $/!