h]ifdZddlZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z mZmZmZdd lmZdd lmZdd lmZmZmZmZdd lmZmZmZmZmZm Z m!Z!dd l"m#Z#ddl$m%Z%dZ&dZ'dZ(dZ)dZ*dZ+dZ,Gdde-Z.dZ/dZ0Gdde-Z1Gdde-Z2Gdde-Z3Gdd e-Z4y)!z?G  @  # * *8 4  $ 2 $  #:(= > #  #x / #K F;$77 ::m,L ;C((*Kg,'C#&99S>K # K   & - -k : ;zz-.H()00:r-cN|dr|djdt|)z:Raise a BulkWriteError from the full bulk api result. rCc |dS)Nr0r:)errors r+z)_raise_bulk_write_error..s eGnr-)key)sortr)rLs r+_raise_bulk_write_errorr\s2=!M"'', ( .  %%r-ceZdZdZdZedZdZ ddZ ddZ ddZ d Z d Z d Z d Zd ZdZdZdZdZy)_Bulkz,The private guts of the bulk write API. c |j|jjdt|_||_g|_d|_||_d|_ d|_ d|_ d|_ d|_ d|_d|_y)z%Initialize a _Bulk instance. replace)unicode_decode_error_handlerdocument_class) codec_optionsFTN) with_optionsrc_replacedict collectionorderedr(executedbypass_doc_valuses_collationuses_array_filters uses_hint is_retryableretryingstarted_retryable_write current_runr*rgrhbypass_document_validations r+r,z_Bulk.__init__s%11$22;;-6#<%2&  8#"'  ',$r-c|jjjj}|r|jst St SN)rgdatabaseclient _encrypter_bypass_auto_encryptionrr)r* encrypters r+bulk_ctx_classz_Bulk.bulk_ctx_classs4OO,,33>> Y>>- -$ $r-ctd|t|tsd|vs t|d<|jj t |fy)z3Add an insert document to the list of ops. document_idN)r isinstancerrr(r2rr*r}s r+ add_insertz_Bulk.add_inserts? "*h78_5(9J&jHUO (+,r-Nct|td|fd|fd|fd|fg}t|}| d|_||d<| d|_||d<| d|_||d <|rd |_|jjt|fy) zACreate an update document and add it to the list of ops. qumultiupsertNT collation arrayFiltershintF) r rr rkrlrmrnr(r2r) r*selectorr rrr array_filtersrcmds r+ add_updatez_Bulk.add_updates v&C?S&MU#h%79:.y9  "&D (C   $&*D #"/C   !DNCK  %D  #'r-ct|td|fd|fdd|fg}t|}| d|_||d<| d|_||d<|j j t|fy) zACreate a replace document and add it to the list of ops. rr)rFrNTrr)r rr rkrmr(r2r)r*rrSrrrrs r+ add_replacez_Bulk.add_replaces~ ,C?S+$6#h%79:.y9  "&D (C   !DNCK #'r-ctd|fd|fg}t|}| d|_||d<| d|_||d<|tk(rd|_|j jt|fy)z@Create a delete document and add it to the list of ops. rlimitNTrrF) rr rkrm _DELETE_ALLrnr(r2r)r*rrrrrs r+ add_deletez_Bulk.add_deletesxC?We$456.y9  "&D (C   !DNCK K  %D  #'r-c#Kd}t|jD]F\}\}}| t|}n|j|k7r|t|}|j ||H|yw)ziGenerate batches of operations, batched by type of operation, in the order **provided**. N) enumerater(r$r&r5)r*rKr/r&r4s r+ gen_orderedz_Bulk.gen_orderedsl)2488)< $ %C%'9{7m' 7m GGC #  $ sA&A(c#Kttttttg}t |j D]\}\}}||j |||D]}|j s|yw)zbGenerate batches of operations, batched by type of operation, in arbitrary order. N)r$rrrrr(r5)r* operationsr/r&r4rKs r+ gen_unorderedz_Bulk.gen_unorderedst7mT']DMB )2488)< 4 %C%'9 w  # #C 3 4 Cww  s A3A=6A=c |jdkr.|jr td|jr td|jdkr|jr td|j j j}|j j j} | j} |jst||_ |j} |j| || rjtt| j|j jfd|j fg} |j"s|j$| d<|j&r|jdk\rd | d <|j)|| ||| || j|j j*} | j,t/| j0krl|rF|r#|j2s|j5d |_|j7| |t8j:|j=| || t?| j0| j,d}| jA|| \}}|jCd i}|jCd d tDvr8tGjH|}tK| || j,|tM|tK| || j,|d|_'d|_|j rd|vrnB| xj,t/|z c_| j,t/| j0krl|j r|dryt|dx|_ } | riyy)Nz5Must be connected to MongoDB 3.4+ to use a collation.z.Must be connected to MongoDB 3.4+ to use hint.z6Must be connected to MongoDB 3.6+ to use arrayFilters.rh writeConcernTbypassDocumentValidationrDcoderFrC)(max_wire_versionrkrrmrlrgrvnamerw_event_listenersrqnextvalidate_sessionr _COMMANDSr&rhis_server_defaultr}rjr{rcr)rGr(rp_start_retryable_write _apply_torPRIMARYsend_cluster_timerexecuterFr rIdeepcopyrUr\ro)r* generator write_concernsession sock_infoop_id retryablerLdb_namerw listenersrKrbwcr(rNto_sendwcefulls r+_execute_commandz_Bulk._execute_commands  % % )""(KMM~~(DFF  % % )d.E.E$HJ J//**//))00++ #ID  ""673 #++.0D0DE!4<<023C 22&3&<&<N#""y'A'AQ'F26./%%i 7 T__::ggdddddgdtfd}jjj}|j |5}|j j ||ddddsdr tS#1swY xYw)z&Execute using write commands. rrCrEr=r@rArBr>r?c 4j|||yru)r)rrrrLrrr*rs r+retryable_bulkz-_Bulk.execute_command..retryable_bulk`s!  ! !='9e; (r-NrCrE)rrgrvrw _tmp_session_retry_with_sessionrnr\) r*rrrrrwsrLrs ``` @@r+execute_commandz_Bulk.execute_commandPs "$    ( ( ))00   ) 1d < < } %5I)J #K 0  < >$@B B   9#=#=#B"$CD D  % % )||66y)LL11)YG G%s4<<'89   ?CIt,H =)=I ;;')22!3y:[[G+%(WW@ 'n%) 4S ?#=#=c#B).J %%cN%h/&%g.*7"'$(LL+/+>+>% @ @"&)WW3  Y%.s^)27);%;%2%*%)\\ 33;H$ <<  sC+HHHc|js td|jr tdd|_|xs|jj}t ||}|j r|j}n|j}|jjj}|js-|j|5}|j||dddy|j|||S#1swYyxYw)zExecute operations. zNo operations to executez*Bulk operations can only be executed once.TN)r(rrirgrrrhrrrvrwr_socket_for_writesrr)r*rrrrwrs r+rz _Bulk.executesxx"#=> > =="$<= = %F)F)F 1'=I <<((*I**,I))00))**73 >y'' 9= > >'' ='J J > >s C55C>)FFNNN)FNN)NN)r6r7r8r9r,propertyr{rrrrrrrrrrrrrr:r-r+r^r^sy (%%-@E<@(,9>)-( (  G;R<B$;62DLKr-r^c,eZdZdZdZdZdZdZdZy)BulkUpsertOperationz/An interface for adding upsert operations.  __selector__bulk __collationc.||_||_||_yru)_BulkUpsertOperation__selector_BulkUpsertOperation__bulk_BulkUpsertOperation__collationr*rbulkrs r+r,zBulkUpsertOperation.__init__" $r-cl|jj|j|dd|jy)zUpdate one document matching the selector. :Parameters: - `update` (dict): the update operations to apply FTrrrNrrrrr*r s r+ update_onezBulkUpsertOperation.update_ones1 t%U4)-)9)9  ;r-cl|jj|j|dd|jy)zUpdate all documents matching the selector. :Parameters: - `update` (dict): the update operations to apply TrNrrs r+r zBulkUpsertOperation.update(s1 t%T$)-)9)9  ;r-cj|jj|j|d|jy)Replace one entire document matching the selector criteria. :Parameters: - `replacement` (dict): the replacement document T)rrN)rrrrr*rSs r+ replace_onezBulkUpsertOperation.replace_one2s. T*.*:*:  eZdZdZdZdZdZdZdZdZ dZ d Z y ) BulkWriteOperationz9An interface for adding update or remove operations. rc.||_||_||_yru)_BulkWriteOperation__selector_BulkWriteOperation__bulk_BulkWriteOperation__collationrs r+r,zBulkWriteOperation.__init__Brr-cj|jj|j|d|jy)zUpdate one document matching the selector criteria. :Parameters: - `update` (dict): the update operations to apply FrrNrrrrrs r+rzBulkWriteOperation.update_oneGs. te)-)9)9  ;r-cj|jj|j|d|jy)zUpdate all documents matching the selector criteria. :Parameters: - `update` (dict): the update operations to apply TrNrrs r+r zBulkWriteOperation.updatePs. td)-)9)9  ;r-ch|jj|j||jy)rrN)rrrrrs r+rzBulkWriteOperation.replace_oneYs, *.*:*:  = 3.2** .. versionchanged:: 3.5 Deprecated. Use :meth:`~pymongo.collection.Collection.bulk_write` instead. .. versionchanged:: 3.2 Added bypass_document_validation support N)r^_BulkOperationBuilder__bulkrrs r+r,zBulkOperationBuilder.__init__s4J1KL r-NcHtd|t||j|S)a;Specify selection criteria for bulk operations. :Parameters: - `selector` (dict): the selection criteria for update and remove operations. - `collation` (optional): An instance of :class:`~pymongo.collation.Collation`. This option is only supported on MongoDB 3.4 and above. :Returns: - A :class:`BulkWriteOperation` instance, used to add update and remove operations to this bulk operation. .. versionchanged:: 3.4 Added the `collation` option. r)rrr)r*rrs r+findzBulkOperationBuilder.finds!$ J1!(DKKCCr-c:|jj|y)zInsert a single document. :Parameters: - `document` (dict): the document to insert .. seealso:: :ref:`writes-and-ids` N)rrrs r+rzBulkOperationBuilder.inserts x(r-cV| tdi|}|jj|dS)zExecute all provided operations. :Parameters: - write_concern (optional): the write concern for this bulk execution. N)rr:)rrr)r*rs r+rzBulkOperationBuilder.executes1  $(9=9M{{""=$"??r-)TFru) r6r7r8r9rr,rrrr:r-r+r r zs+I+/,1M8D*) @r-r )5r9rI itertoolsr bson.objectidr bson.raw_bsonrbson.sonrpymongo.client_sessionrpymongo.commonrr r r pymongo.helpersr pymongo.collationr pymongo.errorsrrrrpymongo.messagerrrrrrrpymongo.read_preferencesrpymongo.write_concernrrr _BAD_VALUE_UNKNOWN_ERROR_WRITE_CONCERN_ERRORrrJobjectr$rUr\r^rrr r:r-r+r#s ")B4438..999 4.    *  #6#>%;P&AKFAKH &<&&