Check if given operation matches any existing records cached in ExtractorInfo.
Check if given operation matches any existing records cached in ExtractorInfo. Note, dataset operation is in the format of "x.y", mimetype of files is in the format of "x/y" this functino expects to parse on delimeters: . or / this function will return false in case of wrong format
mimetypes cached in ExtractorInfo, either operations of dataset or mimetypes of files
dataset operation like "file.added" or mimetype of files, like "image/bmp"
true if matches any existing recorder. otherwise, false.
Escape various characters in content type when creating a routing key
Escape various characters in content type when creating a routing key
original content type in standar form, for example text/csv
escaped routing key
Send message when a file is added to a dataset.
Send message when a file is added to a dataset. Use both old method using topic queues and new method using work queues and extractors registration in Clowder.
the file that was added to the dataset
the dataset it was added to
the Clowder host URL for sharing extractors across instances
Send message when a new file is uploaded to the system.
Send message when a new file is uploaded to the system. This is the same as the method above but it supports TempFile instead of File. This is currently only used for multimedia queries.
the file that was just uploaded
the Clowder host URL for sharing extractors across instances
Publish to the proper queues when a new file is uploaded to the system.
Publish to the proper queues when a new file is uploaded to the system.
the file that was just uploaded
the dataset the file belongs to
the Clowder host URL for sharing extractors across instances
Send message when file is removed from a dataset and deleted.
Send message when file is removed from a dataset and deleted.
Send message when a group of files is added to a dataset via UI.
Send message when a group of files is added to a dataset via UI. Use both old method using topic queues and new method using work queues and extractors registration in Clowder.
the dataset it was added to
the list of files that were added to the dataset
the Clowder host URL for sharing extractors across instances
Return the API key to use in the submission.
Return the API key to use in the submission. If the one in the key is not set in the request then get the default extraction key for the user. If the user is not defined default to the global key. for the user
the API key from the request
the user from the request
the API key to use
a helper function to get user email address from user's request api key.
a helper function to get user email address from user's request api key.
user request apikey
a list of email address
Metadata added to a resource (file or dataset).
Metadata added to a resource (file or dataset).
Metadata removed from a resource (file or dataset).
Metadata removed from a resource (file or dataset).
File upladed for multimedia query.
File upladed for multimedia query. Not a common used feature.
Post the event of SUBMITTED
Post the event of SUBMITTED
the UUID of file
the extractor queue name to be submitted
An existing dataset was manually submitted to the extraction bus by a user.
An existing dataset was manually submitted to the extraction bus by a user.
An existing file was manually submitted to the extraction bus by a user.
An existing file was manually submitted to the extraction bus by a user.
Preview creted for section.
Preview creted for section.
Determine automated extraction messages to send based on Clowder events such as file upload.