jacksonfoz [Fri, 19 Dec 2014 14:09:27 +0000 (12:09 -0200)]
Add support to log timezones with + and - signs
pgbadger does not recognize log files (queries and events) with timezones like 'GMT+3'.
On postgresql.conf file the log_timezone variable is set as 'Etc/GMT+3' and lines are generated like this (stderr format):
2014-12-19 00:02:40 GMT+3 [1981]: [239-1] user=,db= LOG: checkpoint starting: time
Darold Gilles [Wed, 17 Dec 2014 22:47:29 +0000 (23:47 +0100)]
Add --noreport command line option to intruct pgbadger to not build any reports in incremental mode. pgBadger will only create binary files. Thanks to hubert Depesz Lubaczewski for the feature request.
Darold Gilles [Mon, 15 Dec 2014 12:25:27 +0000 (13:25 +0100)]
Add more details about the CSV parser error. It now prints the line number and the last parameter that generate the failure. This should allow to see the malformed log entry.
Dalibo [Tue, 11 Nov 2014 21:49:13 +0000 (22:49 +0100)]
Fix wrong count of min/max queries per second. Thanks to Guillaume Lelarge for the report. Add COPY statement to SELECT or INSERT statements statistics.
Dalibo [Fri, 7 Nov 2014 22:50:56 +0000 (23:50 +0100)]
Add "Average queries per session" and "Average queries duration per session" in Sessions tab of the Global stat. Thanks to Guillaume Lelarge for the feature request.
Dalibo [Fri, 7 Nov 2014 18:03:58 +0000 (19:03 +0100)]
Add --explain-time-consuming and --explain-normalized to generate explain statement about top time consuming and top normalized slowest queries. Thanks to Josh Kupershmid fot the feature request.
Darold Gilles [Tue, 7 Oct 2014 17:25:22 +0000 (19:25 +0200)]
Add -D | --dns-resolv command line option to replace ip adresses by their DNS name. Be warned that this can slow down pgBagder a lot. Thanks to Jiri Hlinka for the feature request.
Darold Gilles [Tue, 7 Oct 2014 08:41:23 +0000 (10:41 +0200)]
Do not display queries in Slowest individual, Time consuming and Normalized slowest queries reports when there is no duration in log file. Diplay NO DATASET instead.
Enable allow_loose_quotes and undef escape_char in Text::CSV_XS call to fix CSV format error when fields have quote inside an unquoted field. Thanks to Josh Berkus for the report.
Add --file-per-query and --format-query option to write each slowest query in a separate file named qryXXX.sql and perform minimal formating of the queries. Thanks to Rodolphe Quiedeville for the patch.
Allow pgbadger_tools --explain-slowest to automatically execute the EXPLAIN statements an report the plan. See pgbadger_tools --help for more explanation.
Add a new program pgbadger_tools.pl to demonstrate how to deal with pgBadger binary files to build your own new feature. The first one 'explain-slowest' allow printing of top slowest queries as EXPLAIN statements.
Darold Gilles [Mon, 25 Aug 2014 15:17:55 +0000 (17:17 +0200)]
- Fix issue in calculating min/max/avg in "General Activity" report. It was build on the sum of queries duration per minutes instead of each duration. Thanks to Jayadevan M for the report.
- The same issue remains with percentile that are build using the sum of duration per minutes and doesn't represent the real queries duration.
- This commit also include a modification in convert_time() method to reports milliseconds.
Darold Gilles [Fri, 22 Aug 2014 13:19:14 +0000 (15:19 +0200)]
Add -B or --bar-graph command line option to use bar instead of line in graph. Thanks to Bart Dopheide for the suggestion. Also fix Checkpoint Wal files usage graph title.
Darold Gilles [Thu, 7 Aug 2014 22:37:51 +0000 (00:37 +0200)]
Add -R | --retention option to set the maximum number of week reports to preserve in the output directory for incremental mode. Thanks to Kong Man for the feature request.
Darold Gilles [Wed, 6 Aug 2014 20:44:32 +0000 (22:44 +0200)]
Fix issue in incremental mode when parsing is stopped after rotating log and rotated log has new lines. The new file was not parsed at all. Thanks to CZAirwolf for the report.
Darold Gilles [Tue, 5 Aug 2014 22:14:47 +0000 (00:14 +0200)]
- Fix issue in handling SIGTERM/SIGINT that cause pgbadger to continue.
- Add autoclean feature to pgbadger in incremental mode. pgbadger will now removed automatically obsolete binary files unless you specify --noclean at command line. Take care that the old behaviour was to keep those unecessary binary files, now they will be removed if there's already a report in the day directory. In incremental mode (-I) only the binary files of the current parsed week are needed. This may help saving disk space.
Darold Gilles [Tue, 5 Aug 2014 18:25:28 +0000 (20:25 +0200)]
Add a global regex definition array named @session_closed_msg to add regex that match fatal error messages that do not generate disconnection line in pg log.
Darold Gilles [Tue, 5 Aug 2014 11:09:06 +0000 (13:09 +0200)]
Add new command line option --anonymize to obscure all literals in queries/errors to hide confidential data. Thanks to wmorancfi for the feature request.
Add a copy icon in front of each query in the report to select the entire query on click. Click and drag to select the query can be a pain, this button is a click-to-select that allow to use Ctrl+c to copy on clipboard. Thanks to Josh Berkus for the feature request.
Allow pgBadger to write out extra files to outdir when creating incremental reports. Require the use of the -X or --extra-files option in incremental mode (-I). Thanks to Matthew Musgrove for the feature request.
Fix an other issue with wrong offset in incremental mode, initial position was 1 instead of 0. Thanks to Herve Werner for the report.
Fix incomplete handling of XZ compressed format.
Fix overcount of sessions when a client attempts to log in and is kicked off because of failed authentication or an incorrect database name. These show up as sessions which connected and never disconnected. Thanks to Josh Berkus for the report.
Add execute attribute to pgbadger in the source repository, some may find this more helpful when pgbadger is not installed and executed directly from this repository.
Darold Gilles [Wed, 25 Jun 2014 22:45:32 +0000 (00:45 +0200)]
Fix issue with csv log format and incremental mode. Thanks to Suya for the report and the help to solve the issue. There also a fix to support autovacuum statistic with csv format.