百度智能云
All Product Document

          Object Storage

          • Object Storage
          • >
          • Console Operation Guide
          • >
          • Event Notification and Data Processing

          Event Notification and Data Processing

          Last Updated：2020-10-26

          Overview

          The BOS Event Notification Function is a set of intelligent trigger platform based on the BOS data processing framework V2.0 . Based on functions provided by the platform, developers can define data behaviors that occur in Bucket of business concern. BOS will monitor behaviors such as Put Object and Append Object that occur in Bucket, and provide downstream business system of users with trigger notification.

          At meanwhile, combining with the strong AI capacity of Baidu AI Cloud, BOS can support the user behaviors monitored and directly trigger the data processing capacities of Baidu AI Cloud, thus provide the results after such processing directly to the downstream business system of the user. It enables the user with stronger AI processing capacity of data while simplifying user development logic and accelerating the business.

          Application Scenarios

          The BOS Event Notification Platform provides the users with an automated data behavior monitoring and notification system. It is capable of meeting the following application scenarios:

          • If new data is uploaded to a certain Bucket, it is required to immediately notify the upper application and the upper application will immediately pull and apply such data.
          • If new image is uploaded to the Bucket, it is required to process the content immediately and the new image generated will be used for front-end presentation. While the original image will be deleted immediately to release the storage space.
          • When a new video is uploaded in the bucket, it needs to be de approved immediately, and the illegal content needs to be cleared immediately.
          • When several operations such as PutObject, DeleteObject, etc. occur in the Bucket, the subsequent custom processing flow needs to be triggered, which can be fulfilled by BOS trigger of CFC.

          Based on many of the above scenarios, BOS users only need to configure the trigger conditions of the event notification in the console, such as the event name, whether to enable encryption authentication, monitoring resources, covering resources, and triggering applications, etc. After the configuration is complete, when the monitored resource of the file under the specified Bucket or the specified prefix changes, the system will automatically trigger the corresponding application.

          Precondition

          • Baidu AI Cloud account is already registered. For specific operation, please see Account Registration.
          • The resources covered in the event notification rule are a Bucket or all files under a certain prefix in a Bucket. Therefore, you need to select the Bucket for creating event notification rules. For details, please refer to Create Bucket.

          Create Rules

          Note: Unretrieved archive type Object will not trigger event notifications, and retrieved archive type Object will trigger normally.

          1.Log in BOS Management Console to enter the overview page. 2.Select Target Bucket from the navigation bar on the left of BOS console and click to open the Bucket files list page. 3.Click the Event Notification tab in the navigation bar at the top of the page to enter the event notification page. 4.Click Create Rule to enter the creation page and configure the following information:

          Parameter Description
          Status Choose whether to enable event notification for new rules.
          Name
          • Support uppercase and lowercase letters, numbers, Chinese and -_ /. special characters.
          • Start with a letter, length 1-65.
          Rule ID
          • Support uppercase and lowercase letters, numbers, and -_ /. Special characters.
          • Start with a letter, length 1-65.
          Product ID
          • Support uppercase and lowercase letters, numbers, and -_ /. Special characters.
          • Start with a letter, length 1-65.
          Encrypted authentication Choose whether to encrypt the event notification rule. If encryption is enabled:
          • Enter a custom password with a length of 32 bits. The password supports uppercase and lowercase letters and numbers, and the length is 32 bits.
          • Or directly enter SK.
          • If only an empty event is created, the key must be set.
          Please remember to save the password in time to avoid losing it. BOS does not save the password.
          Event listening configuration Choose whether to enable event listening configuration as needed. To enable it, you need to configure:
          • Monitoring event : API behavior that occurs in the Bucket. Currently, BOS supports the following types of monitoring events. You can select several types of events as needed.
            • AppendObject, An additional upload occurs;
            • CompleteMutipartUpload, The three-step upload is completed;
            • CopyObject, Data copy behavior occurs;
            • PutObject, A simple upload occurs;
            • PostObject, The form upload behavior occurs;
            • FetchObject, that is, occurrence of fetching and storing resources from the specified URL;
            • DeleteObject, The act of deleting a single Object occurs;
            • DeleteMultipleObjects, that is, occurrence of deleting multiple Objects under the same Bucket.
          • Covering resources : Refer to the data range covered by the rule listening. In addition to supporting Bucket-level resources, coverage resources can also be configured by specifying resource prefixes and suffixes. The same rule can listen to 5 different coverage resources at most.
          • Trigger application : Refer to the downstream business that the rule needs to inform. Users can flexibly set the applications that receive trigger notifications according to their own business architecture. The types of trigger applications consist of three categories: Baidu official applications, Cloud Function Compute (CFC), and custom applications. For details on triggering applications, see Trigger application classification .

          5.Click OK to save the rule configuration information. The successfully created rule can be viewed in the rule list on the "Event Notification" page. You can also modify or delete existing rules.

          Trigger Application Classification

          The types of trigger applications consist of three categories: Baidu official applications, Cloud Function Compute (CFC), and custom applications. Among them, Baidu official application is BOS. Based on the powerful AI processing capabilities of Baidu AI Cloud, it packs many high-frequency and easy-to-use AI applications. Users can enjoy Baidu AI capabilities to empower their business by only setting a URL to receive the application processing results in the console with the lowest development cost and the highest development efficiency.

          Currently, Baidu official applications include Universal Character Recognition, Universal Object Recognition, and Multimedia Cloud Transcoding.

          Application category Application name Application description
          Baidu official applications Universal text recognition
          • Baidu [General Text Recognition Service] supports text detection and recognition in multiple scenarios, and ranks the first worldwide in terms of several ICDAR indexes, making it one of the capabilities with most application and abundance among the AI capabilities of Baidu AI Cloud.
          • When the Universal Character Recognition application is triggered, BOS will automatically push the data uploaded in the Bucket to Baidu Universal Character Recognition service. After the character recognition is completed, BOS will push the recognition result in the form of a specific json file to the receiving URL set by the user.
          General object recognition
          • Baidu Universal Object Recognition service provides users with the ability to analyze, extract, and label the output of photo content, which is very important for upper-level applications such as image clustering and image recognition.
          • When the Universal Object Recognition application is triggered, BOS will automatically push the data uploaded in the Bucket to the Baidu Universal Object Recognition service. After the object recognition is completed, BOS will push the recognition result in the form of a specific json file to the receiving URL set by the user.
          Audio and video transcoding
          • The Multimedia Cloud Transcoding MCT provides efficient, intelligent and stable media processing services for a large number of media, including: Ordinary transcoding, double speed transcoding, intelligent super-definition transcoding, video editing, video encryption, intelligent frame extraction, etc., bringing you a smooth and high-definition playback experience with multiple terminals.
          • When the Universal Multimedia Transcoding application is triggered, BOS will automatically push the multimedia data uploaded to the Bucket to Baidu Multimedia Transcoding service. After the transcoding is completed, BOS will push the result to the receiving URL set by the user.
          Function computing CFC Function computing CFC
          • CFC (Cloud Function Compute) is an event-triggered, fully hosting cloud computing capability officially launched by Baidu AI Cloud.
          • After setting the triggered function computing formula, BOS will automatically push the data uploaded to the Bucket to Baidu Function Compute service. After the computing is completed, BOS will push the computing result to the receiving URL set by the user.
          User-defined application User-defined application
          • A custom application is a user's own APP or other application system at downstream. The user only needs to fill in the URL where the service receives the trigger notification, and the BOS will push the event detected in the Bucket to the URL.
          Previous
          Intelligent Business Analysis
          Next
          Statistics and Monitoring