cron.weekly issue #9: Ian, Apt, PostgreSQL, TLDR, Topbeat, Date, Performance and many moreJanuary 3, 2016 - Mattias Geniar
This is issue #9 for cron.weekly, the first edition of 2016. A happy new year to you all!
This edition features some more ‘light’ open source news as well, I’ll keep the die-hard Unix links for next time. 😉
It’s sad news, but news nonetheless: Ian Murdock, founder of the Debian project, passed away at age 42.
APT’s performance in applying the Pdiffs files, which are the diff format used for Packages, Sources, and other files in the archive has been slow. This blogpost explores why that is the case and what’s being done to fix it.
A nice overview of what’s new in the latest PostgreSQL 9.5 release.
Facebook has a huge open source list. In this blogpost, they look back at their most successful projects of 2015.
Some background to how Facebook implemented a write-ahead log in its software implementation for RAID 5 and RAID 6.
Note: this isn’t a new package manager (we’ve had enough of those), but a set of tools to help you maintain Debian package files. If you’re a package maintainer (in which case: thanks!), make sure to read through the documentation.
Tools & Projects
This network toolkit provides a framework for creating your own packet networking. This writeup is an interesting approach of bypassing the Operating System to get the most out of the hardware.
While I’m still no gamer, this looks old-skool enough to be fun. After almost of a decade of (slow) development, this classic 2D jump’n run sidescroller game (think Super Mario etc.) reaches a stable release. Oh, and it’s completely open source, too.
This is a cool gimmick: a guide to creating your own, open source, watch. It may not have the design of the expensive watches, but it’s completely open.
Sort of similar to the Open Source Watch above, but this time running Unix on the Game Boy Advance. Really detailled write-up on how it got done, too.
Simplified, community-driven, man pages. This project mostly highlights the lack of detailed examples in manpages but an interesting approach, nonetheless.
This newest member of the Elasticsearch family is an open source shipper for per-process CPU, memory, and disk usage metrics. It’s basically a “send top output to Elasticsearch” tool, which allows you to easily visualise the results with Kibana. The release blogpost offers some more details.
Similar to Topbeat above, Packetbeat is open source data shipper that integrates with Elasticsearch and Kibana to provide real-time analytics for web, database, and other network protocols. Consider this the “send tcpdump output to Elasticsearch”. The online demo shows this a lot better than I can explain in 3 sentences.
An integrated shell for working with the AWS CLI.
SQL Tabs is an open source cross platform desktop client for Postgresql with several interesting features.
With BTFS, you can mount any .torrent file or magnet link and then use it as any read-only directory in your file tree. The contents of the files will be downloaded on-demand as they are read by applications. Tools like ls, cat and cp works as expected. Applications like vlc and mplayer can also work without changes.
Guides & tutorials
A short guide on the ‘date’ tool in Linux, how to manipulate its output and jump back/forth in time. A useful guide if you ever need to use time- or date-based variables in your shellscripts.
For users of the RHEL or CentOS distributions, this guide offers practical pointers and tools to tune your system for optimal performance. If you’re left wanting for more, have a look at the official RHEL7 performance tuning guide by Red Hat.
If you’ve ever wanted to get started with Varnish, the caching and load balancing tool, this guide is for you. It offers practical tips and tricks on how to debug Varnish, see the cache rates and optimise the configuration file. Even for non-Varnish users it’s a nice reminder on how the HTTP protocol works.
A very nice diagram on how storage works within the Linux kernel.
This guide shows the implementation details of using ‘git push’ as a deployment mechanism for publishing code to a server.
If you’re a Linux user, a Google search will undoubtedly have lead you to nixCraft at some point. These New Year’s Resolutions are a recommendation, I’ll do my best to follow them as well.
This example shows a sudo configuration that will alert you by mail whenever someone enters a sudo command. The example is a good overview of the different actions and logging you can enable in sudo.