In late 2015 I wrote a post about a command-line tool named jq
, which is used for parsing JSON data. Since that time I’ve referenced jq
in a number of different blog posts (like this one). However, jq
is not the only game in town for parsing JSON data at the command line. In this post, I’ll share a couple more handy CLI tools for working with JSON data.
(By the way, if you’re new to JSON, check out this post for a gentle introduction.)
jp
JMESPath is used by both Amazon Web Services (AWS) in their AWS CLI as well as by Microsoft in the Azure CLI. For examples of JMESPath in action, see the AWS CLI documentation on the --query
functionality, which makes use of server-side JMESPath queries to reduce the amount of data returned by an AWS CLI command (as opposed to filtering on the client side).
However, you can also use JMESPath on the client-side through the jp
command-line utility. As a client-side parsing tool, jp
is similar in behavior to jq
, but I find the JMESPath query language to be a bit easier to use than jq
in Continue reading
In mid-May, I ran an onsite network automation workshop, and the manager organizing the workshop for his team invited me to a dinner with his peers. Not surprisingly, they wanted to hear about the topics covered in the workshop, and as soon as I mentioned Network-Infrastructure-as-Code several of them said “yes, that definitely needs to be covered.”
Read more ...How not to structure your database-backed web applications: a study of performance bugs in the wild Yang et al., ICSE’18
This is a fascinating study of the problems people get into when using ORMs to handle persistence concerns in their web applications. The authors study real-world applications and distil a catalogue of common performance anti-patterns. There are a bunch of familiar things in the list, and a few that surprised me with the amount of difference they can make. By fixing many of the issues that they find, Yang et al., are able to quantify how many lines of code it takes to address the issue, and what performance improvement the fix delivers.
To prove our point, we manually fix 64 performance issues in [the latest versions of the applications under study] and obtain a median speed-up of 2x (and up to 39x max) with fewer than 5 lines of code change in most cases.
The Hyperloop website provides access to a tool you can use to identify and solve some of the common performance issues in your own (Rails) apps.
I’m going to skip the intro parts about what ORMs do and how a typical web app Continue reading
Companies can deploy 2G IoT modules today and upgrade them to NB-IoT or CAT-M when network coverage is more comprehensive.
HPC luminary Jack Dongarra (University Distinguished Professor University of Tennessee) presented a new direction for math libraries at the International Supercomputing conference (ISC) in Frankfurt Germany in his presentation “Numerical Linear Algebra for Future Extreme-Scale Systems (NLAFET)”. …
A New Direction for HPC Math Libraries was written by Nicole Hemsoth at .
"One year on from NotPetya, it seems lessons still haven't been learned. A lack of regular patching of outdated systems because of the issues of downtime and disruption to organisations was the path through which both NotPetya and WannaCry spread, and this fundamental problem remains."This is an attractive claim. It describes the problem in terms of people being "weak" and that the solution is to be "strong". If only organizations where strong enough, willing to deal with downtime and disruption, then problems like this wouldn't happen.
As I mentioned in a previous post, I have been studying the materials for the Cisco CCDE. One thing that has come up only a time or two is that of MTU. MTU, or maximum transmission unit, is the maximum size a chunk of data can be for a given interface. In this article, we are speaking specifically of IP MTU and this is an important distinction that I will clarify later. Network design should incorporate a clear understanding of MTU challenges and operators need to understand what to look for when it is not properly built and configured.
A simplistic example of a problematic design is when there is a link with a smaller MTU somewhere between two endpoints capable of creating larger packets (see the image below). While this environment may work fine, understanding the interaction required between the hosts and the network devices is very important to network design.
A few years ago I wrote an article that outlined some of the behavior that can be witnessed when there are MTU discovery issues. Let’s quickly recount what path MTU discovery (PMTU-D) is, how it works, how it fails and some logic around appropriate design.
The latest cloud orchestration report indicates that CIOs, cloud architects, and other IT infrastructure managers need to educate themselves on an increasingly wide variety of options.
DT deployed a network data layer using HPE’s shared data environment. The shared layering helps the network handle a large variety of workloads while maintaining agility.
The move is tied to the company’s desire to further exploit Google's Kubernetes support. Although the timing is interesting given Microsoft's recent announcement that it is purchasing GitHub.
Lustre has been an essential component of HPC systems for a decade and a half, and has experienced a somewhat turbulent history of shifting ownership followed by uncertain support from various backers as an open source project. …
DDN Breathes New Life Into Lustre File System was written by Daniel Robinson at .
Sarah Novotny, the head of open source strategy for Google Cloud Platform, will join The Linux Foundation board of directors.
For the second quarter in a row Dell Technologies’ brands ranked No. 1 in hyperconverged hardware and software sales.
Broadcast networks are increasingly moving to IP, and this gives them the opportunity to take advantage of a programmable forwarding plane.
The DevOps market was worth nearly $2.8 billion in 2016, and is predicted to grow at an 18.6 percent CAGR through 2025, according to a Grand View Research report.
The IoT business unit of Comcast, machineQ, named new customers that represent new industries and use cases for its low-power wide area network.