]> granicus.if.org Git - pgbadger/log
pgbadger
11 years agoFix top slowest array size with binary format.
Darold Gilles [Sat, 2 Mar 2013 17:23:58 +0000 (18:23 +0100)]
Fix top slowest array size with binary format.

11 years agoFix an other case with bind parameters with value in next line and the top N slowest...
Darold Gilles [Sat, 2 Mar 2013 15:42:12 +0000 (16:42 +0100)]
Fix an other case with bind parameters with value in next line and the top N slowest queries that was repeated until N even if the real number of queries was lower. Thanks to Kjeld Peters for the reports.

11 years agoFix non replacement of bind parameters where there is line breaks in the parameters...
Darold Gilles [Sat, 2 Mar 2013 10:28:34 +0000 (11:28 +0100)]
Fix non replacement of bind parameters where there is line breaks in the parameters, aka multiline bind parameters. Thanks to Kjeld Peters for the report.

11 years agoFix error with seekable export tag with Perl v5.8. Thanks to Jeff Bohmer for the...
Darold Gilles [Sat, 2 Mar 2013 09:27:33 +0000 (10:27 +0100)]
Fix error with seekable export tag with Perl v5.8. Thanks to Jeff Bohmer for the report.

11 years agoFix parsing of syslog lines begining with a timestamp like "2013-02-28T10:35:11-05...
Darold Gilles [Thu, 28 Feb 2013 21:42:27 +0000 (22:42 +0100)]
Fix parsing of syslog lines begining with a timestamp like "2013-02-28T10:35:11-05:00". Thanks to Ryan P. Kelly for the report.

11 years agoFix issue #65 where using -c | --dbclient with csvlog was broken. Thanks to Jaime...
Darold Gilles [Wed, 27 Feb 2013 17:31:42 +0000 (18:31 +0100)]
Fix issue #65 where using -c | --dbclient with csvlog was broken. Thanks to Jaime Casanova for the report.

11 years agoUpdate ChangeLog with last commit for release 3.1.
Darold Gilles [Fri, 22 Feb 2013 00:16:11 +0000 (01:16 +0100)]
Update ChangeLog with last commit for release 3.1.

11 years agoFix empty report in watchlog mode (-w option).
Darold Gilles [Fri, 22 Feb 2013 00:14:43 +0000 (01:14 +0100)]
Fix empty report in watchlog mode (-w option).

11 years agoUpdate ChangeLog and version to 3.1
Darold Gilles [Thu, 21 Feb 2013 23:36:07 +0000 (00:36 +0100)]
Update ChangeLog and version to 3.1

11 years agoFix dies on command line options error.
Darold Gilles [Thu, 21 Feb 2013 23:26:40 +0000 (00:26 +0100)]
Fix dies on command line options error.

11 years agoFix missing report of most frequent events/errors report. Thanks to Vincent Laborie...
Darold Gilles [Thu, 21 Feb 2013 23:21:35 +0000 (00:21 +0100)]
Fix missing report of most frequent events/errors report. Thanks to Vincent Laborie for the report.

11 years agoFix missing report of slowest normalized queries.
Darold Gilles [Thu, 21 Feb 2013 22:55:16 +0000 (23:55 +0100)]
Fix missing report of slowest normalized queries.

11 years agoFix display of last print of progress bar when quiet mode is enabled.
Darold Gilles [Thu, 21 Feb 2013 22:41:20 +0000 (23:41 +0100)]
Fix display of last print of progress bar when quiet mode is enabled.

11 years agoUpdate Changelog for v3.0
Darold Gilles [Wed, 20 Feb 2013 20:51:52 +0000 (21:51 +0100)]
Update Changelog for v3.0

11 years agoAdd more details about parallel parsing.
Darold Gilles [Wed, 20 Feb 2013 20:40:38 +0000 (21:40 +0100)]
Add more details about parallel parsing.

11 years agoFix freeze of pgbadger in multiprocess mode with -e or -d filtering options
Darold Gilles [Wed, 20 Feb 2013 20:37:49 +0000 (21:37 +0100)]
Fix freeze of pgbadger in multiprocess mode with -e or -d filtering options

11 years agoFix multiprocess freeze issue introduce in previous patch.
Darold Gilles [Tue, 19 Feb 2013 09:20:06 +0000 (10:20 +0100)]
Fix multiprocess freeze issue introduce in previous patch.

11 years agoUpdate to version 3.0
Darold Gilles [Mon, 18 Feb 2013 22:24:58 +0000 (23:24 +0100)]
Update to version 3.0

11 years agoUpdate documentation about log_duration, log_min_duration_statement and log_statement.
Darold Gilles [Mon, 18 Feb 2013 22:19:32 +0000 (23:19 +0100)]
Update documentation about log_duration, log_min_duration_statement and log_statement.

11 years agoRewrite dirty code around log timestamp comparison to find the specified begin or...
Darold Gilles [Mon, 18 Feb 2013 22:18:24 +0000 (23:18 +0100)]
Rewrite dirty code around log timestamp comparison to find the specified begin or ending date.

11 years agoRemove distinction between log with duration enable from log_min_duration_statement...
Darold Gilles [Sun, 17 Feb 2013 23:14:40 +0000 (00:14 +0100)]
Remove distinction between log with duration enable from log_min_duration_statement and log_duration. Commands line options --enable-log_duration and --enable-log_duration have been removed too.

11 years agoUpdate documentation about parallel processing
Darold Gilles [Sun, 17 Feb 2013 00:12:50 +0000 (01:12 +0100)]
Update documentation about parallel processing

11 years agoUpdate Changelog
Darold Gilles [Sat, 16 Feb 2013 23:48:43 +0000 (00:48 +0100)]
Update Changelog

11 years agoRemove usage of Storable::file_magic to autodetect binary format file, it is not...
Darold Gilles [Thu, 14 Feb 2013 11:19:17 +0000 (12:19 +0100)]
Remove usage of Storable::file_magic to autodetect binary format file, it is not include in core perl 5.8. Thanks to Marc Cousin for the report.

11 years agoForce multiprocess per file when files are compressed. Thanks to Julien Rouhaud for...
Darold Gilles [Wed, 13 Feb 2013 09:33:52 +0000 (10:33 +0100)]
Force multiprocess per file when files are compressed. Thanks to Julien Rouhaud for the report.

11 years agoAdd progress bar logger for multiprocess by forking a dedicated process and using...
Darold Gilles [Tue, 12 Feb 2013 18:14:42 +0000 (19:14 +0100)]
Add progress bar logger for multiprocess by forking a dedicated process and using pipe. Also fix some bugs in using binary format that duplicate query/error samples per process.

11 years agochmod 755 pgbadger
Darold Gilles [Wed, 6 Feb 2013 18:43:07 +0000 (19:43 +0100)]
chmod 755 pgbadger

11 years agoFix display of reference array instead of errors samples informations.
Darold Gilles [Wed, 6 Feb 2013 18:15:26 +0000 (19:15 +0100)]
Fix display of reference array instead of errors samples informations.

11 years agoFix display of empty table with --enable-log_min_duration on a file without statement.
Darold Gilles [Wed, 6 Feb 2013 11:15:18 +0000 (12:15 +0100)]
Fix display of empty table with --enable-log_min_duration on a file without statement.

11 years agoFix checkpoint reports when there is on checkpoint warnings.
Darold Gilles [Wed, 6 Feb 2013 10:53:52 +0000 (11:53 +0100)]
Fix checkpoint reports when there is on checkpoint warnings.

11 years agoFix non report of hourly connections/checkpoint/autovacuum when not query is found...
Darold Gilles [Tue, 5 Feb 2013 16:13:49 +0000 (17:13 +0100)]
Fix non report of hourly connections/checkpoint/autovacuum when not query is found in log file. Thanks to Guillaume Lelarge for the report.

11 years agoRemove the use of Proc::Queue for multiprocess support.
Darold Gilles [Tue, 5 Feb 2013 13:27:40 +0000 (14:27 +0100)]
Remove the use of Proc::Queue for multiprocess support.

11 years agoAdd better handling of signal in multiprocess mode.
Darold Gilles [Tue, 5 Feb 2013 13:03:02 +0000 (14:03 +0100)]
Add better handling of signal in multiprocess mode.

11 years agoAdd -J|--job_per_file command line option to force pgbadger to use one process per...
Darold Gilles [Tue, 5 Feb 2013 09:01:39 +0000 (10:01 +0100)]
Add -J|--job_per_file command line option to force pgbadger to use one process per file instead of using all process to parse a file. Useful to have better performances with lot of small log file.

11 years agoFix parsing of orphan lines with stderr logs and log_line_prefix without session...
Darold Gilles [Tue, 5 Feb 2013 08:42:52 +0000 (09:42 +0100)]
Fix parsing of orphan lines with stderr logs and log_line_prefix without session information into the prefix (%l).

11 years agoUpdate documentation about -j | --jobs option.
Darold Gilles [Thu, 31 Jan 2013 16:32:55 +0000 (17:32 +0100)]
Update documentation about -j | --jobs option.

11 years agoAllow pgbadger to use several cores, aka multiprocessing. Add -j | --jobs option...
Darold Gilles [Thu, 31 Jan 2013 16:28:35 +0000 (17:28 +0100)]
Allow pgbadger to use several cores, aka multiprocessing. Add -j | --jobs option to specify the number of core to use.

11 years agoAdd autovacuum and autoanalyze infos to binary format.
Darold Gilles [Wed, 30 Jan 2013 10:05:25 +0000 (11:05 +0100)]
Add autovacuum and autoanalyze infos to binary format.

11 years agoFix case in SQL code highlighting where QQCODE temp keyword was not replaced. Thanks...
Darold Gilles [Mon, 28 Jan 2013 21:04:38 +0000 (22:04 +0100)]
Fix case in SQL code highlighting where QQCODE temp keyword was not replaced. Thanks to Julien Ruhaud for the report.

11 years agoFix CSS to draw autovacuum graph and change legend opacity.
Darold Gilles [Sat, 26 Jan 2013 15:15:12 +0000 (16:15 +0100)]
Fix CSS to draw autovacuum graph and change legend opacity.

11 years agoAdd pie graph to show repartition of number of autovacuum per table and number of...
Darold Gilles [Fri, 25 Jan 2013 12:09:34 +0000 (13:09 +0100)]
Add pie graph to show repartition of number of autovacuum per table and number of tuples removed by autovacuum per table.

11 years agoAdd debug information about selected type of log duration format.
Darold Gilles [Thu, 24 Jan 2013 22:15:40 +0000 (23:15 +0100)]
Add debug information about selected type of log duration format.

11 years agoAdd report of tuples/pages removed in report of Vacuums by table.
Darold Gilles [Thu, 17 Jan 2013 23:10:22 +0000 (00:10 +0100)]
Add report of tuples/pages removed in report of Vacuums by table.

11 years agoFix major bug on syslog parser where years part of the date was wrongly extracted...
Darold Gilles [Thu, 17 Jan 2013 20:42:59 +0000 (21:42 +0100)]
Fix major bug on syslog parser where years part of the date was wrongly extracted from current date with logs generated in 2012.

11 years agoMerge pull request #56 from gleu/autovacuum
Darold [Thu, 17 Jan 2013 20:15:27 +0000 (12:15 -0800)]
Merge pull request #56 from gleu/autovacuum

Autovacuum

11 years agoFix strange issue with Perl 5.16 that do not allow "ss" inside look-behind assertion...
Darold Gilles [Thu, 17 Jan 2013 18:44:05 +0000 (19:44 +0100)]
Fix strange issue with Perl 5.16 that do not allow "ss"  inside look-behind assertions. Thanks to Cedric for the report.

11 years agoNew autovacuum hourly report and its graph
Guillaume Lelarge [Thu, 17 Jan 2013 15:33:29 +0000 (16:33 +0100)]
New autovacuum hourly report and its graph

11 years agoTwo new reports: VACUUM/ANALYZE per table
Guillaume Lelarge [Thu, 17 Jan 2013 13:32:11 +0000 (14:32 +0100)]
Two new reports: VACUUM/ANALYZE per table

11 years agoUpdate release to 2.3
Darold Gilles [Thu, 17 Jan 2013 11:30:45 +0000 (12:30 +0100)]
Update release to 2.3

11 years agoUpdate ChangeLog.
Darold Gilles [Thu, 17 Jan 2013 11:29:00 +0000 (12:29 +0100)]
Update ChangeLog.

11 years agoUpdate year in copyright.
Darold Gilles [Thu, 17 Jan 2013 11:23:24 +0000 (12:23 +0100)]
Update year in copyright.

11 years agoChange doc/pgBadger.pod to reflect Matt Romaine README patch.
Darold Gilles [Wed, 9 Jan 2013 21:35:13 +0000 (22:35 +0100)]
Change doc/pgBadger.pod to reflect Matt Romaine README patch.

11 years agoMerge pull request #54 from mromaine/log_duration-readme-clarification
Darold [Wed, 9 Jan 2013 21:32:08 +0000 (13:32 -0800)]
Merge pull request #54 from mromaine/log_duration-readme-clarification

Clarify misleading statement about log_duration

11 years agoFix --dbname and --dbuser issue with csvlog format. Thanks to Luke Cyca for the report.
Darold Gilles [Wed, 9 Jan 2013 21:27:41 +0000 (22:27 +0100)]
Fix --dbname and --dbuser issue with csvlog format. Thanks to Luke Cyca for the report.

11 years agoClarify misleading statement about log_duration
Matt (on joker) [Tue, 8 Jan 2013 05:30:49 +0000 (05:30 +0000)]
Clarify misleading statement about log_duration

log_duration may be turned on depending on desired information.
Only log_statement must not be on.

11 years agoAdd missing SQL::Beautify paternity.
Darold Gilles [Mon, 7 Jan 2013 16:54:02 +0000 (17:54 +0100)]
Add missing SQL::Beautify paternity.

12 years agoFix issue in SQL formatting that prevent left back indentation when major keywords...
Darold Gilles [Fri, 4 Jan 2013 14:08:11 +0000 (15:08 +0100)]
Fix issue in SQL formatting that prevent left back indentation when major keywords were found. Thanks to Kevin Brannen for the report.

12 years agoDisplay 3 decimal in time report so that ms can be seen. Thanks to Adam Schroder...
Darold Gilles [Wed, 2 Jan 2013 10:55:20 +0000 (11:55 +0100)]
Display 3 decimal in time report so that ms can be seen. Thanks to Adam Schroder for the request.

12 years agoForce the parser to not insert a new line after the SET keyword when the query begin...
Darold [Sun, 30 Dec 2012 18:37:59 +0000 (19:37 +0100)]
Force the parser to not insert a new line after the SET keyword when the query begin with it. This is to preserve the single line with queries like SET client_encoding TO "utf8";

12 years agoAdd better SQL formatting of update queries by adding a new line after the SET keywor...
Darold [Sat, 29 Dec 2012 10:11:26 +0000 (11:11 +0100)]
Add better SQL formatting of update queries by adding a new line after the SET keyword. Thanks to pilat66 for the report.

12 years agoUpdate documentation.
Darold Gilles [Thu, 27 Dec 2012 10:55:01 +0000 (11:55 +0100)]
Update documentation.

12 years agoQueries without application name are stored under others application name.
Darold Gilles [Thu, 27 Dec 2012 10:53:56 +0000 (11:53 +0100)]
Queries without application name are stored under others application name.

12 years agoAdd report of number of queries by application if %a is specified in the log_line_prefix.
Darold Gilles [Thu, 27 Dec 2012 10:38:07 +0000 (11:38 +0100)]
Add report of number of queries by application if %a is specified in the log_line_prefix.

12 years agoAdd link menu to the request per database and limit the display of this information...
Darold Gilles [Thu, 27 Dec 2012 09:00:36 +0000 (10:00 +0100)]
Add link menu to the request per database and limit the display of this information when there is more than one database.

12 years agoAdd report of requests per database.
Darold Gilles [Wed, 26 Dec 2012 19:13:39 +0000 (20:13 +0100)]
Add report of requests per database.

12 years agoAdd report of user,remote client and application name to all request info.
Darold Gilles [Wed, 26 Dec 2012 18:05:18 +0000 (19:05 +0100)]
Add report of user,remote client and application name to all request info.

12 years agoFix memory leak with option -b (--begin) and in incremental log parsing mode.
Darold Gilles [Mon, 24 Dec 2012 18:04:33 +0000 (19:04 +0100)]
Fix memory leak with option -b (--begin) and in incremental log parsing mode.

12 years agoRemove duration from log format auto-detection. Thanks to Guillaume Lelarge for the...
Darold Gilles [Mon, 24 Dec 2012 09:31:49 +0000 (10:31 +0100)]
Remove duration from log format auto-detection. Thanks to Guillaume Lelarge for the report.

12 years agoFix a performance issue on prettifying SQL queries that makes pgBagder several time...
Darold Gilles [Sun, 23 Dec 2012 17:20:33 +0000 (18:20 +0100)]
Fix a performance issue on prettifying SQL queries that makes pgBagder several time slower that usual to generate the HTML output. Thanks to Vincent Laborie for the report.

12 years agoFix populating of %_error_info.
Darold Gilles [Sun, 23 Dec 2012 15:02:50 +0000 (16:02 +0100)]
Fix populating of %_error_info.

12 years agoMerge pull request #50 from ioguix/storable
Darold [Fri, 21 Dec 2012 16:04:06 +0000 (08:04 -0800)]
Merge pull request #50 from ioguix/storable

Add 'binary' format as input/output format

12 years agoAdd 'binary' format as input/output format
Jehan-Guillaume (ioguix) de Rorthais [Fri, 21 Dec 2012 12:43:34 +0000 (13:43 +0100)]
Add 'binary' format as input/output format

The binary output format allows to save log statistics in a non human
readable file instead of an HTML or text file. These binary files might
then be used as regular input files, combined or not, to produce a html
or txt report.

12 years agoRemove port from the session regex pattern to match all lines.
Darold [Sun, 16 Dec 2012 17:14:06 +0000 (18:14 +0100)]
Remove port from the session regex pattern to match all lines.

12 years agoMerge pull request #49 from eulerto/master
Darold [Fri, 14 Dec 2012 13:29:29 +0000 (05:29 -0800)]
Merge pull request #49 from eulerto/master

cosmetic patches

12 years agoFix the progress bar. It was trying to use gunzip to get real file size
Euler Taveira de Oliveira [Fri, 14 Dec 2012 13:00:52 +0000 (11:00 -0200)]
Fix the progress bar. It was trying to use gunzip to get real file size
for all formats (by default). Unbreak the bz2 format (that does not
report real size) and add support for zip format.

12 years agoFix some typos and grammatical issues.
Euler Taveira de Oliveira [Fri, 14 Dec 2012 12:25:35 +0000 (10:25 -0200)]
Fix some typos and grammatical issues.

12 years agoImprove SQL code highlighting and keywords detection using the same parser as in...
Darold Gilles [Tue, 11 Dec 2012 22:48:37 +0000 (23:48 +0100)]
Improve SQL code highlighting and keywords detection using the same parser as in site http://sqlformat.darold.net/. Thanks to Alex Gaynor for the feature request.

12 years agoFix issue #46, to add support to hostname or ip address in the client detection....
Darold Gilles [Mon, 10 Dec 2012 08:51:54 +0000 (09:51 +0100)]
Fix issue #46, to add support to hostname or ip address in the client detection. Thanks to stuntmunkee for the report.

12 years agoFix issue #45, pgbadger will now only reports execute statement of the extended proto...
Darold Gilles [Mon, 10 Dec 2012 08:39:38 +0000 (09:39 +0100)]
Fix issue #45, pgbadger will now only reports execute statement of the extended protocol (parse/bind/execute). Thanks to pierrestroh for the report.

12 years agoMerge pull request #44 from darkixion/master
Darold [Wed, 5 Dec 2012 22:55:19 +0000 (14:55 -0800)]
Merge pull request #44 from darkixion/master

Fix numerous typos as well as formatting and grammatical issues.

12 years agoFix numerous typos as well as formatting and grammatical issues.
Thom Brown [Wed, 5 Dec 2012 22:45:12 +0000 (22:45 +0000)]
Fix numerous typos as well as formatting and grammatical issues.

12 years agoAdd backward compatibility to obsolete --client command line option. If you were...
Darold Gilles [Wed, 5 Dec 2012 18:01:35 +0000 (19:01 +0100)]
Add backward compatibility to obsolete --client command line option. If you were using the short option -c nothing is changed.

12 years agoMerge pull request #43 from rjuju/fix_dbclient
Darold [Wed, 5 Dec 2012 17:54:02 +0000 (09:54 -0800)]
Merge pull request #43 from rjuju/fix_dbclient

Small fix for issue with --dbclient and %h in log_line_prefix

12 years agoSmall fix for issue with --dbclient and %h in log_line_prefix
Julien Rouhaud [Wed, 5 Dec 2012 17:31:18 +0000 (18:31 +0100)]
Small fix for issue with --dbclient and %h in log_line_prefix

12 years agoFix multiline progress bar output.
Darold [Sat, 1 Dec 2012 10:28:33 +0000 (11:28 +0100)]
Fix multiline progress bar output.

12 years agoAllow usage of a dash into database, user and application names when prefix is used...
Darold Gilles [Thu, 22 Nov 2012 16:24:00 +0000 (17:24 +0100)]
Allow usage of a dash into database, user and application names when prefix is used. Thanks to Vipul for the report.

12 years agoMouse over queries will now show in which database they are executed in the overviews...
Darold Gilles [Thu, 22 Nov 2012 12:51:08 +0000 (13:51 +0100)]
Mouse over queries will now show in which database they are executed in the overviews (Slowest queries, Most frequent queries, etc. ). Thank to Dirk-Jan Bulsink for the feature request.

12 years agoAdd some code optimization.
Darold Gilles [Thu, 22 Nov 2012 10:54:03 +0000 (11:54 +0100)]
Add some code optimization.

12 years agoFix missing keys on %cur_info hash foreach loop. Thanks to Marc Cousin for the report.
Darold Gilles [Wed, 21 Nov 2012 13:24:51 +0000 (14:24 +0100)]
Fix missing keys on %cur_info hash foreach loop. Thanks to Marc Cousin for the report.

12 years agoMove openning file handle to log file into a dedicated function. Thanks to Marc Cousi...
Darold Gilles [Wed, 21 Nov 2012 11:00:31 +0000 (12:00 +0100)]
Move openning file handle to log file into a dedicated function. Thanks to Marc Cousin for the patch.

12 years agoReplace Ctrl+M by printable \r. Thanks to Marc Cousin for the report.
Darold Gilles [Tue, 20 Nov 2012 13:23:29 +0000 (14:23 +0100)]
Replace Ctrl+M by printable \r. Thanks to Marc Cousin for the report.

12 years agoUpdate version to 2.2
Darold Gilles [Wed, 14 Nov 2012 09:20:52 +0000 (10:20 +0100)]
Update version to 2.2

12 years agoUpdate Changelog and release version 2.2
Darold Gilles [Tue, 13 Nov 2012 20:38:48 +0000 (21:38 +0100)]
Update Changelog and release version 2.2

12 years agoAdd two more Pg keywords and run perltidy.
Darold Gilles [Tue, 13 Nov 2012 20:16:16 +0000 (21:16 +0100)]
Add two more Pg keywords and run perltidy.

12 years agoFix number of queries in progress bar with tsung output.
Darold Gilles [Tue, 13 Nov 2012 11:08:32 +0000 (12:08 +0100)]
Fix number of queries in progress bar with tsung output.

12 years agoRemove obsolete syslog-ng and temporary syslog-ll log format added to fix some syslog...
Darold Gilles [Mon, 12 Nov 2012 22:14:19 +0000 (23:14 +0100)]
Remove obsolete syslog-ng and temporary syslog-ll log format added to fix some syslog autodetection issues. There is now just one syslog format: syslog, differences between syslog formats are detected and the log parser is adaptive.

12 years agoAdd comment about the check_incremental_position() method
Darold Gilles [Mon, 12 Nov 2012 18:33:07 +0000 (19:33 +0100)]
Add comment about the check_incremental_position() method

12 years agoFix bad report with empty graphs when log files was not in chronological order.
Darold Gilles [Mon, 12 Nov 2012 15:49:43 +0000 (16:49 +0100)]
Fix bad report with empty graphs when log files was not in chronological order.

12 years agoAdd report of the current total of queries and events parsed in progress bar. Thanks...
Darold Gilles [Wed, 7 Nov 2012 14:05:43 +0000 (15:05 +0100)]
Add report of the current total of queries and events parsed in progress bar. Thanks to Jehan-Guillaume de Rorthais for the patch.

12 years agoFix parser on syslog with level info after the timestamp like <local0.info>. Thanks...
Darold Gilles [Wed, 7 Nov 2012 10:53:59 +0000 (11:53 +0100)]
Fix parser on syslog with level info after the timestamp like <local0.info>. Thanks to Jehan-Guillaume de Rorthais for the report.