#Ccmenu circle ci code#

#Ccmenu circle ci code#

gcp_cloud_function_proxy/ - debug your cloud function networking by querying a given URL to check its accessibility, returning the HTTP status code and content.gcp_cloud_function_ifconfig/ - debug your cloud function public networking by determining its public IP address - use this to test your VPC connector public routing, comparison with firewall rules etc.see the DevOps Bash tools repo for several related GCP SQL to set up service account permissions and Cloud Scheduler jobs.gcp_cloud_function_sql_export/ - runs Cloud SQL export backups to GCS, subscribing to PubSub topic that is triggered by Cloud Scheduler.GCF - Google Cloud Functions written in Python:.Optionally filters for users with passwords not used in the last N days aws_users_pw_last_used.py - lists all users and dates since their passwords were last used.Optionally filters for users not used in the last N days to find old accounts to remove aws_users_last_used.py - lists all users and their days since last use across both passwords and access keys.aws_users_unused_access_keys.py - lists users access keys that haven't been used in the last N days or that have never been used (these should generally be removed/disabled).Optionally filters for active keys and older than N days (for key rotation governance) aws_users_access_key_age.py - lists all users access keys, status, date of creation and age in days.profile (there is also a perl version in my DevOps Perl Tools repo) welcome.py - cool spinning welcome message greeting your username and showing last login time and user to put in your shell's.See further down for more details and sub-programs that simplify usage for many of the most common cluster technologies Multi-threaded for speed and highly configurable - socket, http, https, ping, url and/or regex content match.

Elasticsearch, Hadoop, HBase, Cassandra etc). find_active_server.py - finds fastest responding healthy server or active master in high availability deployments, useful for scripting against clustered technologies (eg.find_duplicate_files.py - finds duplicate files in one or more directory trees via multiple methods including file basename, size, MD5 comparison of same sized files, or bespoke regex capture of partial file basename.On servers this parallelization can result in a 30x speed up for large log files Preserves order of evaluation important for anonymization rules, as well as maintaining file content order. anonymize_parallel.sh - splits files in to multiple parts and runs anonymize.py on each part in parallel before re-joining back in to a file of the same name with a.-hash-hostnames - hashes hostnames to look like Docker temporary container ID hostnames so that vendors support teams can differentiate hosts in clusters.-ip-prefix leaves the last IP octect to aid in cluster debugging to still see differentiated nodes communicating with each other to compare configs and log communications.placeholder tokens indicate what was stripped out (eg.anonymize_nf - put regex of your Name/Company/Project/Database/Tables to anonymize to.Cisco & Juniper ScreenOS configurations passwords, shared keys and SNMP strings.CN, DN, OU, UID, sAMAccountName, member, memberOf.) AWS Access Keys, Secret Keys, ARNs, STS tokens.anonymize.py - anonymizes your configs / logs from files or stdin (for pasting to Apache Jira tickets or mailing lists).$AMBARI_HOST, $HBASE_HOST take priority over $HOST. These are indicated in the -help descriptions in brackets next to each option and often have more specific overrides with higher precedence eg. UsageĪll programs come with a -help switch which includes a program description and the list of command line options.Įnvironment variables are supported for convenience and also to hide credentials from being exposed in the process list eg. Some Hadoop tools with require Jython, see Jython for Hadoop Utils for details. Make sure to read Detailed Build Instructions further down for more information.