]>
granicus.if.org Git - pgbadger/log
Gilles Darold [Mon, 3 Jun 2019 02:42:56 +0000 (04:42 +0200)]
Add report per database support to incremental mode. In this mode there
will be a sub directory per database with dedicated incremental reports
and time based sub directory storing the binary statistic data.
Add -H, --html-dir option to be able to set a different path where HTML
report must be written in incremental mode. Binary files remain on directory
defined with -O, --outdir option.
Gilles Darold [Sun, 2 Jun 2019 13:45:06 +0000 (15:45 +0200)]
Add -E | --explode option to explode the main report into one report
per database. Global information not related to a database are added
to the postgres database report.
Update regression test to works with new structure introduced with the
per database report feature.
Gilles Darold [Wed, 22 May 2019 07:10:22 +0000 (09:10 +0200)]
Fix documentation URL. Thanks to Kara Mansel for the report.
Gilles Darold [Tue, 21 May 2019 09:07:25 +0000 (11:07 +0200)]
Fix parsing of auto_explain.
Darold Gilles [Sun, 21 Apr 2019 08:45:25 +0000 (10:45 +0200)]
Add more information about -U option that can be used multiple time. Thanks to Douglas J Hunley for the report.
Gilles Darold [Fri, 19 Apr 2019 10:28:33 +0000 (12:28 +0200)]
Apply conflicting pull request #493 of Pierre Giraud.
Gilles Darold [Fri, 19 Apr 2019 10:06:14 +0000 (12:06 +0200)]
Merge pull request #491 from pgiraud/html_validation
Fix some invalid HTML issues
Gilles Darold [Fri, 19 Apr 2019 10:05:56 +0000 (12:05 +0200)]
Merge pull request #490 from pgiraud/hash_position
Hash position
Pierre GIRAUD [Wed, 17 Apr 2019 07:13:47 +0000 (09:13 +0200)]
Fix not allowed nesting elements
Pierre GIRAUD [Wed, 17 Apr 2019 07:12:17 +0000 (09:12 +0200)]
Fix table number of columns in colspan
Pierre GIRAUD [Wed, 17 Apr 2019 06:42:27 +0000 (08:42 +0200)]
Fix invalid DOM, <tr> in <div>
Pierre GIRAUD [Tue, 16 Apr 2019 13:53:08 +0000 (15:53 +0200)]
Make sure panel header is visible on navigation click
Pierre GIRAUD [Tue, 16 Apr 2019 08:35:30 +0000 (10:35 +0200)]
Harmonization of panels spacing
Less space lost
Gilles Darold [Tue, 16 Apr 2019 13:06:11 +0000 (15:06 +0200)]
Merge pull request #489 from pgiraud/auto_scroll
Update source file - See #485
Gilles Darold [Tue, 16 Apr 2019 13:05:48 +0000 (15:05 +0200)]
Merge pull request #488 from pgiraud/main_container_margin
Update source file - See #483
Pierre GIRAUD [Tue, 16 Apr 2019 12:47:53 +0000 (14:47 +0200)]
Update source file - See #485
Pierre GIRAUD [Tue, 16 Apr 2019 12:39:30 +0000 (14:39 +0200)]
Update source file - See #483
Gilles Darold [Tue, 16 Apr 2019 12:27:48 +0000 (14:27 +0200)]
Merge pull request #485 from pgiraud/auto_scroll
WIP - Scroll to top when clicking on top menu item
Gilles Darold [Tue, 16 Apr 2019 12:27:30 +0000 (14:27 +0200)]
Merge pull request #483 from pgiraud/main_container_margin
WIP - Margin on top of body
Gilles Darold [Tue, 16 Apr 2019 12:26:59 +0000 (14:26 +0200)]
Merge pull request #487 from darold/revert-486-hash_position
Revert "WIP - Hash position"
Gilles Darold [Tue, 16 Apr 2019 12:24:55 +0000 (14:24 +0200)]
Merge pull request #484 from pgiraud/top_queries_heading
Fix top queries header inconsistency
Gilles Darold [Tue, 16 Apr 2019 12:23:58 +0000 (14:23 +0200)]
Revert "WIP - Hash position"
Gilles Darold [Tue, 16 Apr 2019 12:22:31 +0000 (14:22 +0200)]
Merge pull request #486 from pgiraud/hash_position
WIP - Hash position
Pierre GIRAUD [Tue, 16 Apr 2019 09:04:12 +0000 (11:04 +0200)]
Make sure panel header is visible on navigation click
Pierre GIRAUD [Tue, 16 Apr 2019 08:35:30 +0000 (10:35 +0200)]
Harmonization of panels spacing
Less space lost
Pierre GIRAUD [Tue, 16 Apr 2019 08:58:04 +0000 (10:58 +0200)]
Scroll to top when clicking on top menu item
Pierre GIRAUD [Tue, 16 Apr 2019 08:37:37 +0000 (10:37 +0200)]
Fix top queries header inconsistency
Pierre GIRAUD [Tue, 16 Apr 2019 08:37:05 +0000 (10:37 +0200)]
Margin on top of body
Avoids <br> hack
Gilles Darold [Tue, 16 Apr 2019 07:14:09 +0000 (09:14 +0200)]
Merge pull request #482 from darold/pgiraud-patch-1
Fix markdown format
Pierre GIRAUD [Tue, 16 Apr 2019 07:03:28 +0000 (09:03 +0200)]
Fix markdown format
Darold Gilles [Sun, 7 Apr 2019 08:05:59 +0000 (10:05 +0200)]
Add regression test for logplex format.
Darold Gilles [Fri, 15 Mar 2019 12:35:13 +0000 (13:35 +0100)]
Add support to Heroku's PostgreSQL logplex format. You should be able to
parse these logs as follow:
heroku logs -p postgres | pgbadger -f logplex -o heroku.html -
or if you have already saved the output to a file:
pgbadger heroku.log
The logplex format is autodectected like any other supported format.
pgBadger understand the following default log_line_prefix:
database = %d connection_source = %r sql_error_code = %e
or simply:
sql_error_code = %e
Let me know if there's any other default log_line_prefix. The prefix
can always be set using the -p | --prefix pgbadger option:
pgbadger --p 'base = %d source = %r sql_state = %e' heroku.log
for example.
Thanks to Anthony Sosso for the feature request.
Gilles Darold [Fri, 22 Feb 2019 10:01:16 +0000 (11:01 +0100)]
Fix pgbadger help on URI use.
Gilles Darold [Fri, 22 Feb 2019 09:28:29 +0000 (10:28 +0100)]
Fix broken wildcard use in ssh URI introduced in previous patch. Thanks to Tobias Bussmann for the report.
Gilles Darold [Thu, 21 Feb 2019 21:17:53 +0000 (22:17 +0100)]
Allow URI with space in path to log file. Thanks to Tobias Bussmann for the report.
Gilles Darold [Thu, 21 Feb 2019 20:39:47 +0000 (21:39 +0100)]
Merge pull request #478 from tbussmann/patch-1
Fix URI samples in documentation
Tobias Bussmann [Thu, 21 Feb 2019 20:31:55 +0000 (21:31 +0100)]
Fix URI samples in documentation
Gilles Darold [Tue, 19 Feb 2019 12:19:19 +0000 (13:19 +0100)]
Merge pull request #474 from credativ/test-duration
t/02_basics.t: Don't fail if syslog test takes more than 10s
Christoph Berg [Tue, 19 Feb 2019 11:45:41 +0000 (12:45 +0100)]
t/02_basics.t: Don't fail if syslog test takes more than 10s
The syslog test checks if the result is exactly 24281 bytes, but if the
run takes 10s or more, the result is longer.
Generated on Tue Feb 19 12:24:58 2019
Log file: t/fixtures/pg-syslog.1.bz2
Parsed 59,921 log entries in 19s <-- PROBLEM HERE
Log start from 2019-02-11 13:15:39 to 2019-02-11 13:16:26
Gilles Darold [Thu, 14 Feb 2019 10:29:41 +0000 (11:29 +0100)]
Update ChangeLog and version to 10.3
Gilles Darold [Mon, 11 Feb 2019 13:17:40 +0000 (14:17 +0100)]
Remove extra space at end of line.
Gilles Darold [Mon, 11 Feb 2019 13:14:49 +0000 (14:14 +0100)]
Add minimal test to syslog parser.
Gilles Darold [Mon, 11 Feb 2019 12:50:11 +0000 (13:50 +0100)]
Fix a call to autodetect_format().
Gilles Darold [Sun, 10 Feb 2019 11:01:04 +0000 (12:01 +0100)]
Fix statistics reports when there a filter on database, user, client or
application is requested. Some queries was not reported.
Gilles Darold [Fri, 8 Feb 2019 10:46:38 +0000 (11:46 +0100)]
Merge branch 'master' of github.com:darold/pgbadger
Gilles Darold [Fri, 8 Feb 2019 10:43:34 +0000 (11:43 +0100)]
Fix autodetection of pg>=10 defauilt log line prefix.
Gilles Darold [Fri, 8 Feb 2019 07:42:30 +0000 (08:42 +0100)]
Fix autodetection of log file with "non standard" log line prefix. If
--prefix specify %t | %m | %n and %p or %c, set format to stderr. Thanks
to Alex Danvy for the report.
Gilles Darold [Wed, 23 Jan 2019 15:51:55 +0000 (16:51 +0100)]
Merge pull request #471 from madtibo/truncate_error_statement
Truncate error statement
madtibo [Wed, 23 Jan 2019 13:34:49 +0000 (14:34 +0100)]
truncate statement when maxlength is used
madtibo [Wed, 23 Jan 2019 13:33:08 +0000 (14:33 +0100)]
editor config changes
Gilles Darold [Tue, 22 Jan 2019 17:42:40 +0000 (18:42 +0100)]
Add test for multiple output format.
Gilles Darold [Tue, 22 Jan 2019 12:00:00 +0000 (13:00 +0100)]
The -o | --outfile option can now be used multiple time to dump
output in several format in a single command. For example:
pgbadger -o out.txt -o out.html -o - -x json /log/postgresql-11.log
Here pgbadger will create two reports in text and html format saved
in the two corresponding file. It will also output a json report on
standard output. Thanks to Nikolay for the feature request.
Gilles Darold [Mon, 21 Jan 2019 12:22:56 +0000 (13:22 +0100)]
Move detection of output format and setting of out filename into a dedicated function set_output_extension().
Gilles Darold [Sun, 20 Jan 2019 20:30:05 +0000 (21:30 +0100)]
Fix another pgBouncer log parsing issue. Thanks to Douglas J Hunley for the report.
Gilles Darold [Thu, 27 Dec 2018 22:54:33 +0000 (23:54 +0100)]
Update Changelog and version to 10.2
Gilles Darold [Thu, 27 Dec 2018 22:51:11 +0000 (23:51 +0100)]
Update usage of pgbadger.
Gilles Darold [Thu, 27 Dec 2018 22:40:06 +0000 (23:40 +0100)]
Update pgbadger command examples.
Gilles Darold [Thu, 27 Dec 2018 22:16:53 +0000 (23:16 +0100)]
Adjust end of progress bar with files with estimate size (bz2 compressed files and remote compressed files.
Gilles Darold [Sun, 23 Dec 2018 22:11:14 +0000 (23:11 +0100)]
Update year in copyright.
Gilles Darold [Sun, 23 Dec 2018 22:07:50 +0000 (23:07 +0100)]
Add information about URI notation to parse remote log files.
Gilles Darold [Sun, 23 Dec 2018 21:52:49 +0000 (22:52 +0100)]
Force progress to reach 100% at end of parsing of compressed remote file.
Gilles Darold [Sun, 23 Dec 2018 21:27:30 +0000 (22:27 +0100)]
Extract information about PL/pgSQL function call in queries of temporary file reports. The information is append to the details display block.
Gilles Darold [Sun, 23 Dec 2018 16:10:36 +0000 (17:10 +0100)]
Fix progress bar with csv files.
Gilles Darold [Sat, 22 Dec 2018 22:11:58 +0000 (23:11 +0100)]
Fix reading binary file as input file instead of log file.
Gilles Darold [Fri, 21 Dec 2018 08:21:53 +0000 (09:21 +0100)]
Encode html output of queries into UTF8 to avoid message "Wide character
in print". Thanks to Colin 't Hart for the report.
Gilles Darold [Mon, 17 Dec 2018 20:42:04 +0000 (21:42 +0100)]
Add Checkpoints distance key/value for distance peak.
Gilles Darold [Sat, 8 Dec 2018 13:05:05 +0000 (14:05 +0100)]
Fix pgbouncer parsing and request throughput reports. Thanks to Levente Birta for the report.
Gilles Darold [Sat, 1 Dec 2018 16:59:15 +0000 (17:59 +0100)]
Fix some typo.
Gilles Darold [Sat, 1 Dec 2018 16:58:02 +0000 (17:58 +0100)]
Fix use of csvlog instead of csv for input format.
Gilles Darold [Mon, 26 Nov 2018 21:43:59 +0000 (22:43 +0100)]
Add support to http or ftp remote PostgreSQL log file download.
The log file is parsed during the download using curl command
and never saved to disk. With ssh remote log parsing you can use
uri as comand line argument to specify the PostgreSQL log file.
ssh://localhost/postgresql-10-main.log
http://localhost/postgresql-10-main.log.gz
ftp://localhost/postgresql-10-main.log
with http and ftp protocol you need to specify the log file format
at end of the uri:
http://localhost/postgresql-10-main.log:stderr
You can specify multiple uri for log files to be parsed. This is
usefull when you have pgbouncer log file on a remote host and
PostgreSQL logs in the local host.
Old syntax to parse remote log file using -r option is still
working but is obsolete and might be removed in two or three
major versions.
Gilles Darold [Thu, 15 Nov 2018 17:23:58 +0000 (18:23 +0100)]
Add support to pgbouncer 1.8 Stats log format. Thanks to Levente Birta for the report.
Gilles Darold [Fri, 9 Nov 2018 12:40:40 +0000 (13:40 +0100)]
Add warning about parallel processing disabled with csvlog. Thanks to cstdenis for the report.
Gilles Darold [Fri, 9 Nov 2018 12:17:54 +0000 (13:17 +0100)]
Add information in usage output about single process forcing with csvlog
format in -j and -J options. Thanks to cstdenis for the report.
Gilles Darold [Fri, 19 Oct 2018 13:09:09 +0000 (15:09 +0200)]
Fix unknown line format error for multiline log while incremental analysis over ssh. Thanks to Wooyoung Cho for the report.
Gilles Darold [Thu, 18 Oct 2018 08:37:49 +0000 (10:37 +0200)]
Add -k (--insecure) option to curl command to be able to download logs from server using a self signed certificate.
Gilles Darold [Wed, 17 Oct 2018 17:21:23 +0000 (19:21 +0200)]
Auto adjust javascript graph timezone. Thanks to Massimino Sala for the feature request.
Gilles Darold [Fri, 12 Oct 2018 09:19:49 +0000 (11:19 +0200)]
Add support to HTTP logfile download by pgBadger, for example:
/usr/bin/pgbadger http://www.mydom.com/postgresql-10.log
Will parse the file during download using curl command.
Gilles Darold [Thu, 11 Oct 2018 20:30:16 +0000 (22:30 +0200)]
Apply change to README by 0xflotus to source file doc/pgBadger.pod.
Gilles Darold [Thu, 11 Oct 2018 20:28:45 +0000 (22:28 +0200)]
Merge pull request #448 from 0xflotus/patch-1
fixed being
0xflotus [Wed, 10 Oct 2018 23:30:33 +0000 (01:30 +0200)]
fixed being
Gilles Darold [Fri, 5 Oct 2018 13:16:09 +0000 (15:16 +0200)]
Reapply fix missing replacement of bind parameters after some extra code cleaning. Thanks to Bernhard J. M. Grun for the report.
Gilles Darold [Fri, 5 Oct 2018 13:11:04 +0000 (15:11 +0200)]
Revert "Fix missing replacement of bind parameters. Thanks to Bernhard J. M. Grun for the report."
This reverts commit
14fef5ec9bb6be25a657b4199e0764374114a2b7 .
Gilles Darold [Fri, 5 Oct 2018 12:30:18 +0000 (14:30 +0200)]
Fix missing replacement of bind parameters. Thanks to Bernhard J. M. Grun for the report.
Gilles Darold [Tue, 25 Sep 2018 03:52:23 +0000 (05:52 +0200)]
Add --exclude-db option to compute report about everything except the specified database. The option can be used multiple time.
Gilles Darold [Thu, 13 Sep 2018 06:35:56 +0000 (08:35 +0200)]
Restore Makefile.PL
Gilles Darold [Wed, 12 Sep 2018 19:19:47 +0000 (21:19 +0200)]
Update ChangelLog and version to 10.1
Gilles Darold [Wed, 12 Sep 2018 19:16:18 +0000 (21:16 +0200)]
Update SQL beautifier to v3.1 of pgFormatter.
Gilles Darold [Wed, 12 Sep 2018 18:55:07 +0000 (20:55 +0200)]
Add test on pgbouncer log parser.
Gilles Darold [Wed, 12 Sep 2018 13:59:20 +0000 (15:59 +0200)]
Some little performances improvment.
Gilles Darold [Wed, 12 Sep 2018 09:48:57 +0000 (11:48 +0200)]
Fix not a valid file descriptor at pgbadger line 12314.
Gilles Darold [Wed, 12 Sep 2018 08:54:56 +0000 (10:54 +0200)]
Fix unwanted newline in progressbar at startup.
Gilles Darold [Wed, 12 Sep 2018 08:39:19 +0000 (10:39 +0200)]
Remove circleci files from the project.
Gilles Darold [Tue, 11 Sep 2018 21:37:46 +0000 (23:37 +0200)]
Remove dependency of bats and jq for the test suite, they are replaced
with Test::Simple and JSON::XS.
Add more tests especially for incremental mode and input from stdin that
was broken in release 10.0.
Thanks a lot to Etienne Bersac who have initiate the pgbadger test suite
and added the contributing on pgBadger documentation.
Gilles Darold [Tue, 11 Sep 2018 21:32:53 +0000 (23:32 +0200)]
Merge pull request #435 from credativ/fix-pod
Sync pgbadger, pod, and README, and fix some syntax errors
Gilles Darold [Tue, 11 Sep 2018 21:17:06 +0000 (23:17 +0200)]
Add documentation on how to install Perl module JSON::XS from apt and yum repositories.
Gilles Darold [Tue, 11 Sep 2018 18:46:26 +0000 (20:46 +0200)]
Fix URI for CSS in incremental mode. Thanks to Floris van Nee for the report.
Gilles Darold [Tue, 11 Sep 2018 18:27:59 +0000 (20:27 +0200)]
Merge branch 'master' of github.com:darold/pgbadger
Gilles Darold [Tue, 11 Sep 2018 18:27:08 +0000 (20:27 +0200)]
Fix fatal error when looking for log from STDIN. Thanks to Jacek Szpot for the report.
Gilles Darold [Tue, 11 Sep 2018 15:03:36 +0000 (17:03 +0200)]
Merge pull request #438 from SteveNewson/osx_sed_support
Fixes SED use for OSX builds
Steve Newson [Tue, 11 Sep 2018 14:50:06 +0000 (15:50 +0100)]
Fixes SED use for OSX builds