{"id":2361,"date":"2018-04-30T07:00:08","date_gmt":"2018-04-30T01:30:08","guid":{"rendered":"http:\/\/www.upnxtblog.com\/?p=2361"},"modified":"2018-04-19T16:16:52","modified_gmt":"2018-04-19T10:46:52","slug":"scumblr-intelligent-automation-framework","status":"publish","type":"post","link":"https:\/\/www.upnxtblog.com\/index.php\/2018\/04\/30\/scumblr-intelligent-automation-framework\/","title":{"rendered":"Use Scumblr if you are looking for intelligent automation framework"},"content":{"rendered":"<div class='booster-block booster-read-block'><\/div><p><a href=\"https:\/\/github.com\/Netflix\/scumblr\/\" target=\"_blank\" rel=\"noopener\">Scumblr<\/a> is a web application that allows performing periodic syncs of data sources (such as Github repositories and URLs) and performing analysis (such as static analysis, dynamic checks, and metadata collection) on the identified results.\u00a0Scumblr searches using plugins called\u00a0<em>Tasks<\/em>. Each Task knows how to perform a search or sync via a certain site or API (Github, Route53, Google, Pastebin, Twitter, etc.). Tasks can be configured from within Scumblr based on the options available by the Task.<\/p>\n<h2>Key Features :<\/h2>\n<p>Scumblr ships with a number of tasks to help you streamline security automation including:<\/p>\n<h3>Sync Tasks<\/h3>\n<ul>\n<li>Github\u00a0&#8211; Sync results from github Repositories<\/li>\n<li>Route53 DNS\u00a0&#8211; Sync FQDNs from Route53 DNS<\/li>\n<li>Manual Result Upload\u00a0&#8211; Specify a new line delimited list of results you&#8217;d like to sync into Scumblr<\/li>\n<\/ul>\n<h3><a id=\"user-content-security-tasks\" class=\"anchor\" href=\"https:\/\/github.com\/Netflix\/scumblr\/wiki#security-tasks\" aria-hidden=\"true\" target=\"_blank\" rel=\"noopener\"><\/a>Security Tasks<\/h3>\n<ul>\n<li>Github Search\u00a0&#8211; Search Github for secrets, anti-patterns, and vulnerabilities in your repositories<\/li>\n<li>Curl\u00a0&#8211; Execute curl commands to identify vulnerabilities or issues against Scumblr results<\/li>\n<li>Bandit\u00a0&#8211; Perform static code analysis against Python projects<\/li>\n<li>Brakeman\u00a0&#8211; Perform static code analysis against Ruby on Rails projects.<\/li>\n<\/ul>\n<h3><a id=\"user-content-search-tasks-legacy\" class=\"anchor\" href=\"https:\/\/github.com\/Netflix\/scumblr\/wiki#search-tasks-legacy\" aria-hidden=\"true\" target=\"_blank\" rel=\"noopener\"><\/a>Search Tasks (legacy)<\/h3>\n<ul>\n<li>Google<\/li>\n<li>Facebook<\/li>\n<li>Twitter<\/li>\n<li>iTunes Store<\/li>\n<li>Certificate Transparency<\/li>\n<li>Ebay<\/li>\n<li>Google Play<\/li>\n<li>Reddit<\/li>\n<li>RSS Feeds (useful for full disclosure searches)<\/li>\n<li>YouTube<\/li>\n<\/ul>\n<p>Scumblr also provides a number of other features that streamline security automation including:<\/p>\n<ul>\n<li>Tracking, ticketing, regression monitoring, and auto-remediation of security vulnerabilities<\/li>\n<li>Metadata storage in results to allow for advanced result filtering<\/li>\n<li>Customizable views and sorting of results and tasks to get you to the important details faster<\/li>\n<li>Saveable result filters that can be shared with collegues<\/li>\n<li>Event model for auditing changes to results so you can keep an eye on what is happening<\/li>\n<li>Email subscriptions for specific results or tasks you care about (such as monitoring when a security task finds a new vulnerablity)<\/li>\n<li>Advanced asynchronous task scheduling to allow for task chaining and task batching<\/li>\n<\/ul>\n<h2>Use Cases:<\/h2>\n<p>Following are just sample of what you might want to look for or analyze<\/p>\n<ul>\n<li>Your organization&#8217;s public or private github repositories<\/li>\n<li>When new FQDNS are created in your organization&#8217;s DNS<\/li>\n<li>Detection of anti-patterns in source code<\/li>\n<li>Dynamic checks against running web servers for security issues<\/li>\n<li>Static code analysis across a large number of repositories using Brakeman or Bandit<\/li>\n<li>Get an alert on full disclosure security reports on vulnerabilities in your team&#8217;s version of Apache<\/li>\n<\/ul>\n<p>Take a look at the\u00a0<a class=\"internal present\" href=\"https:\/\/github.com\/Netflix\/Scumblr\/wiki\/Setting-up-Scumblr-2.0-%28New-install%29\" target=\"_blank\" rel=\"noopener\">wiki<\/a>\u00a0for detailed instructions on setup, configuration, and use!<\/p>\n<p>Also checkout <a href=\"https:\/\/github.com\/Netflix\/Scumblr\/wiki\/Getting-Started\" target=\"_blank\" rel=\"noopener\">Getting Started guide<\/a> for some basic use cases of Scumblr.<\/p>\n<p><em><strong>Like this post? Don\u2019t forget to share it!<\/strong><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Scumblr is a web application that allows performing periodic syncs of data sources (such as Github repositories and URLs) and performing analysis (such as static analysis, dynamic checks, and metadata collection) on the identified results.\u00a0Scumblr searches using plugins called\u00a0Tasks. Each Task knows how to perform a search or sync via a certain site or API [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[3],"tags":[250],"class_list":["post-2361","post","type-post","status-publish","format-standard","hentry","category-new-tools","tag-scumblr"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p9fbQS-C5","jetpack-related-posts":[{"id":7136,"url":"https:\/\/www.upnxtblog.com\/index.php\/2023\/02\/27\/how-to-sync-files-between-cloud-storage-services-multcloud-review\/","url_meta":{"origin":2361,"position":0},"title":"How to Sync Files between Cloud Storage Services \u2013 MultCloud Review","author":"Karthik","date":"February 27, 2023","format":false,"excerpt":"What Is Cloud Sync? Cloud sync always keeps files and folders on client devices and cloud storage the same. One-way sync means uploading files to the cloud when they\u2019re edited or modified. While two-way sync means changes on items in the original and target folders will be reflected in both\u2026","rel":"","context":"In &quot;Best Tools\/Open Source Libs&quot;","block_context":{"text":"Best Tools\/Open Source Libs","link":"https:\/\/www.upnxtblog.com\/index.php\/category\/new-tools\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2023\/02\/multi1.png?fit=1200%2C509&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2023\/02\/multi1.png?fit=1200%2C509&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2023\/02\/multi1.png?fit=1200%2C509&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2023\/02\/multi1.png?fit=1200%2C509&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2023\/02\/multi1.png?fit=1200%2C509&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":678,"url":"https:\/\/www.upnxtblog.com\/index.php\/2017\/10\/18\/ifttt-free-web-based-automation-service\/","url_meta":{"origin":2361,"position":1},"title":"IFTTT free web based automation service","author":"Karthik","date":"October 18, 2017","format":false,"excerpt":"IFTTT is the free web based automation service for small tasks between Internet-connected services. Some of the sample services includes Facebook, Twitter, Dropbox, Evernote, Nest, Fitbit, Amazon Alexa, and Gmail.For example, if you make a status update on one service (a trigger), IFTTT service will make sure an action takes\u2026","rel":"","context":"In &quot;Best Tools\/Open Source Libs&quot;","block_context":{"text":"Best Tools\/Open Source Libs","link":"https:\/\/www.upnxtblog.com\/index.php\/category\/new-tools\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/10\/IFTTT-1024x158.png?resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/10\/IFTTT-1024x158.png?resize=350%2C200 1x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/10\/IFTTT-1024x158.png?resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/10\/IFTTT-1024x158.png?resize=700%2C400 2x"},"classes":[]},{"id":5574,"url":"https:\/\/www.upnxtblog.com\/index.php\/2020\/06\/19\/google-it-automation-with-python-professional-certificate\/","url_meta":{"origin":2361,"position":2},"title":"Google IT Automation with Python Professional Certificate","author":"Karthik","date":"June 19, 2020","format":false,"excerpt":"We have already looked at TOP 100 Coursera Specializations and today we will check out a six-course certificate, developed by Google, is designed to provide IT professionals with in-demand skills including Python, Git, and IT automation that can help you advance your career. Coursera Specialization is a series of courses\u2026","rel":"","context":"In &quot;Learn something new everyday&quot;","block_context":{"text":"Learn something new everyday","link":"https:\/\/www.upnxtblog.com\/index.php\/category\/courses\/"},"img":{"alt_text":"school","src":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/11\/back-to-school-2628012_1920.jpg?fit=1200%2C776&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/11\/back-to-school-2628012_1920.jpg?fit=1200%2C776&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/11\/back-to-school-2628012_1920.jpg?fit=1200%2C776&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/11\/back-to-school-2628012_1920.jpg?fit=1200%2C776&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/11\/back-to-school-2628012_1920.jpg?fit=1200%2C776&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":8040,"url":"https:\/\/www.upnxtblog.com\/index.php\/2025\/09\/04\/the-ultimate-guide-to-building-smarter-workflows-with-n8n\/","url_meta":{"origin":2361,"position":3},"title":"The Ultimate Guide to Building Smarter Workflows with n8n","author":"Karthik","date":"September 4, 2025","format":false,"excerpt":"In today\u2019s fast-paced digital world, automation is no longer a luxury\u2014it\u2019s a necessity. From startups to large enterprises, businesses are constantly looking for ways to streamline processes, reduce manual effort, and improve efficiency. One tool that has been steadily gaining popularity in the developer and automation communities is n8n, an\u2026","rel":"","context":"In &quot;Best Tools\/Open Source Libs&quot;","block_context":{"text":"Best Tools\/Open Source Libs","link":"https:\/\/www.upnxtblog.com\/index.php\/category\/new-tools\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/09\/1746592314512.png?fit=889%2C500&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/09\/1746592314512.png?fit=889%2C500&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/09\/1746592314512.png?fit=889%2C500&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/09\/1746592314512.png?fit=889%2C500&ssl=1&resize=700%2C400 2x"},"classes":[]},{"id":7973,"url":"https:\/\/www.upnxtblog.com\/index.php\/2025\/05\/12\/automate-pr-mr-checks-with-danger-js-streamline-your-code-review-process\/","url_meta":{"origin":2361,"position":4},"title":"Automate PR\/MR Checks with Danger JS: Streamline Your Code Review Process","author":"Karthik","date":"May 12, 2025","format":false,"excerpt":"As development teams scale, maintaining code quality across pull requests (PRs) and merge requests (MRs) becomes increasingly challenging. Manual reviews often involve repetitive tasks like verifying changelog updates, ensuring test coverage, or checking for proper formatting which can be time-consuming and error-prone. Danger JS offers a solution by automating these\u2026","rel":"","context":"In &quot;Best Tools\/Open Source Libs&quot;","block_context":{"text":"Best Tools\/Open Source Libs","link":"https:\/\/www.upnxtblog.com\/index.php\/category\/new-tools\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/05\/danger-logo-hero%402x-676f4223.png?fit=1200%2C382&ssl=1&resize=350%2C200","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/05\/danger-logo-hero%402x-676f4223.png?fit=1200%2C382&ssl=1&resize=350%2C200 1x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/05\/danger-logo-hero%402x-676f4223.png?fit=1200%2C382&ssl=1&resize=525%2C300 1.5x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/05\/danger-logo-hero%402x-676f4223.png?fit=1200%2C382&ssl=1&resize=700%2C400 2x, https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2025\/05\/danger-logo-hero%402x-676f4223.png?fit=1200%2C382&ssl=1&resize=1050%2C600 3x"},"classes":[]},{"id":3811,"url":"https:\/\/www.upnxtblog.com\/index.php\/2019\/05\/01\/how-much-do-you-know-about-dockerhub-hack\/","url_meta":{"origin":2361,"position":5},"title":"Quiz: How Much Do You Know about Dockerhub hack ?","author":"Karthik","date":"May 1, 2019","format":false,"excerpt":"On Thursday, April 25th, 2019, there was unauthorized access to a single Docker Hub database storing a subset of non-financial user data (approximately 190,000 users had been exposed).Docker has reacted quickly to minimize\/nullify the risk of attackers misusing the data,in this post we take look at key points about attack\u2026","rel":"","context":"In &quot;Trending&quot;","block_context":{"text":"Trending","link":"https:\/\/www.upnxtblog.com\/index.php\/category\/trending\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.upnxtblog.com\/wp-content\/uploads\/2017\/11\/docker_facebook_share.png?fit=336%2C287&ssl=1&resize=350%2C200","width":350,"height":200},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2361","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/comments?post=2361"}],"version-history":[{"count":3,"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2361\/revisions"}],"predecessor-version":[{"id":2365,"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/posts\/2361\/revisions\/2365"}],"wp:attachment":[{"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/media?parent=2361"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/categories?post=2361"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.upnxtblog.com\/index.php\/wp-json\/wp\/v2\/tags?post=2361"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}