Helix SwarmHelix Swarm
Loading...

About

log_analyzer takes a VTRACK log file as input, and produces a  formatted text report listing the commands with longest compute phases, longest database lock times, and so on.
  • 4
    Members
  • 5
    Followers
  • 1
    Branch
Owners
pascal_soccard (Pascal Soccard)perforce_software (perforce_software)robert_cowham (Robert Cowham)tom_tyler (C. Thomas Tyler)vkanczes (vkanczes)
Members
lester_cheung (Lester Cheung)perforce_software (perforce_software)robert_cowham (Robert Cowham)tom_tyler (C. Thomas Tyler)
Followers
P4_jhalbig (P4_jhalbig)harold_s_mackiernan (Harold S. MacKiernan)roadkills_r_us (roadkills_r_us)rwillyoung (rwillyoung)vkanczes (vkanczes)
Branches
  • main

  • All Activity
  • Followed Activity
  • Reviews
  • Commits
  • Comments
  • Jobs
4 months agoRobert Cowham committed change 30872 into main
Fix releases link
Add a comment
4 months agoRobert Cowham committed change 30871 into main
Mark files as deprecated.
Add a comment
2 years agoPascal Soccard committed change 29553 into psla
Removed KB broken link and add direct link to the p4clog.py script
Add a comment
4 years agoC. Thomas Tyler approved review 11090 for psla
cmclouth improvements #review @lester_cheung
* Resolved whitespace indentation problems that prevent it from working on Windows.
* Converted to Pytho...n 3.x
** convert print to print()
** convert iteritems() to items()
** change exception handling
** cast float to int (line 175)
* Changed Table sort to consider the combination of both ReadWaitTime and WriteWaitTime (line 423.) «
4 comments
4 years agoC. Thomas Tyler commented on review 11090 for main

I haven't, and I'm guessing if you're asking, you haven't either. Next time I've a need to deploy PLSA, I'll see if I can get it test (if you don't b

...

I haven't, and I'm guessing if you're asking, you haven't either. Next time I've a need to deploy PLSA, I'll see if I can get it test (if you don't beat me to it).

 «
4 comments
4 years agoRobert Cowham commented on review 11090 for main

In principle OK. In practice - have we tested!

4 comments
4 years agoC. Thomas Tyler commented on review 11090 for main

@robert_cowham, now that we've taken this project over, can we pull this change from @cmclouth in? Is it still relevant given the overhaul done a year

...

@robert_cowham, now that we've taken this project over, can we pull this change from @cmclouth in? Is it still relevant given the overhaul done a year or so back? Either way, let's clear out this legacy review.

 «
4 comments
4 years agoscott_common created PSLA-5 for perforce-software-log-analyzer:
Storage lock data in 2019.1 and later logs skewing results.


The storageup, and I suppose the storageupmaster possibly, are putting lock times on
o...ther tables.

$ log2sql --version
log2sql, version v0.8.1 (branch: master, revision: c834aaf)
  build user:       rcowham@perforce.com
  build date:       2020-09-05T19:01:35+0100
  go version:       go1.13.4

....
--- db.workingx
---   total lock wait+held read/write 0ms+31ms/0ms+1856ms
---   max lock wait+held read/write 0ms+31ms/0ms+1855ms
--- db.change
---   total lock wait+held read/write 7ms+1ms/2337ms+0ms
---   max lock wait+held read/write 7ms+1ms/2337ms+0ms
--- storageup/storageup(R)
---   total lock wait+held read/write 0ms+1635446ms/0ms+0ms

    startTime    endTime    running    user    cmd    pid    tableName    maxReadHeld    maxWriteHeld    totalReadWait    totalReadHeld    totalWriteWait
0    2020/10/13 16:55:29    2020/10/13 17:22:45    184    supadhyayula    user-shelve    44149    change    1    0    0    1635446    0 «
Add a comment
6 years agoscott_common modified PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.


Often with performance issues, you're attempting to analyze a specific... time frame from a log.
The log may be large and span more time than you're interested in so being able to create a
database from a specified time range would be useful, and faster than pulling in the entire log
and querying on a specific date/time range. «
Add a comment
6 years agoscott_common modified PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.


Often with performance issues, you're attempting to analyze a specific... time frame from a log.
The log may be large and span more time than you're interested in so being able to create a
database from a specified time range would be useful, and faster than pulling in the
entire log and querying on a specific date/time range. «
Add a comment
6 years agoscott_common modified PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.


Often with performance issues, you're attempting to analyze a specific... time frame from a log.
The log may be large and span more time than you're interested in so being able to create a
database from a specified time range would be useful, and faster than pulling in the entire log and querying on a specific date/time range. «
Add a comment
6 years agoscott_common modified PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.


Often with performance issues, you're attempting to analyze a specific... time frame from a log.
The log may be large and span more time than you're interested in so being able to create a database from a specified time range would be useful, and faster than pulling in the entire log and querying on a specific date/time range. «
Add a comment
6 years agoscott_common modified PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.


Often with performance issues, you're attempting to analyze a specific... time frame from a log. The log may be large and span more time than you're interested in so being able to create a database from a specified time range would be useful, and faster than pulling in the entire log and querying on a specific date/time range. «
Add a comment
6 years agoscott_common modified PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.
Often with performance issues, you're attempting to analyze a specific t...ime frame from a log. The log may be large and span more time than you're interested in so being able to create a database from a specified time range would be useful, and faster than pulling in the entire log and querying on a specific date/time range. «
Add a comment
6 years agoscott_common created PSLA-4 for perforce-software-log-analyzer:
Add a flag that allows pulling in only data from a specified date/time range.
Often with performance issues, you're attempting to analyze a specific t...ime frame from a log. The log may be large and span more time that you're interested in so being able to create a database from a specified time range would be useful, and faster than pulling in the entire log and querying on a specific date/time range. «
Add a comment
6 years agoRobert Cowham committed change 25221 into psla
Fix links for new home in workshop
Add a comment
6 years agoRobert Cowham committed change 25217 into psla
Add readme again
Add a comment
6 years agoRobert Cowham committed change 25216 into psla
Branch files to Workshop mandated path for project
Add a comment
6 years agoRobert Cowham committed change 25215 into psla
Remove psla branch
Add a comment
6 years agoRobert Cowham committed change 25213 into psla
Populate -o //guest/perforce_software/utils/log_analyzer/README.md //guest/perforce_software/log-analyzer/psla/README.md.
Add a comment
6 years agoPerforce maintenance modified PSLA-3 for perforce-software-log-analyzer:
Docker instructions flawed

Looking at https://swarm.workshop.perforce.com/files/guest/perforce_software/utils/log_analyzer/README.md the docker instr...uctions appear to be flawed (perhaps a newer version of Docker is required?)

perforce@dwhitfield-ubuntu2012vsphere:~$ make build
docker build -t psla psla
docker - version 1.4
Copyright 2003, Ben Jansens <ben@orodu.net>

Usage: docker [OPTIONS]

Options:
  -help             Show this help.
  -display DISPLAY  The X display to connect to.
  -border           The width of the border to put around the
                    system tray icons. Defaults to 1.
  -vertical         Line up the icons vertically. Defaults to
                    horizontally.
  -wmaker           WindowMaker mode. This makes docker a
                    fixed size (64x64) to appear nicely in
                    in WindowMaker.
                    Note: In this mode, you have a fixed
                    number of icons that docker can hold.
  -iconsize SIZE    The size (width and height) to display
                    icons as in the system tray. Defaults to
                    24.
  -color COLOR      The background color to use for the tray.
                    Defaults to whatever color the window
                    manager specifies.
make: *** [build] Error 1 «
2 comments
6 years agoC. Thomas Tyler modified PSLA-1 for perforce-software-log-analyzer:
Release the PSLA in The Workshop.
Add a comment
7 years agoDoug Whitfield modified PSLA-3 for perforce-software-log-analyzer:
Docker instructions flawed

Looking at https://swarm.workshop.perforce.com/files/guest/perforce_software/utils/log_analyzer/README.md the docker instr...uctions appear to be flawed (perhaps a newer version of Docker is required?)

perforce@dwhitfield-ubuntu2012vsphere:~$ make build
docker build -t psla psla
docker - version 1.4
Copyright 2003, Ben Jansens <ben@orodu.net>

Usage: docker [OPTIONS]

Options:
  -help             Show this help.
  -display DISPLAY  The X display to connect to.
  -border           The width of the border to put around the
                    system tray icons. Defaults to 1.
  -vertical         Line up the icons vertically. Defaults to
                    horizontally.
  -wmaker           WindowMaker mode. This makes docker a
                    fixed size (64x64) to appear nicely in
                    in WindowMaker.
                    Note: In this mode, you have a fixed
                    number of icons that docker can hold.
  -iconsize SIZE    The size (width and height) to display
                    icons as in the system tray. Defaults to
                    24.
  -color COLOR      The background color to use for the tray.
                    Defaults to whatever color the window
                    manager specifies.
make: *** [build] Error 1 «
2 comments
7 years agoDoug Whitfield created PSLA-3 for perforce-software-log-analyzer:
Looking at https://swarm.workshop.perforce.com/files/guest/perforce_software/utils/log_analyzer/README.md the docker instructions appear to be flawed... (perhaps a newer version of Docker is required?)

perforce@dwhitfield-ubuntu2012vsphere:~$ make build
docker build -t psla psla
docker - version 1.4
Copyright 2003, Ben Jansens <ben@orodu.net>

Usage: docker [OPTIONS]

Options:
  -help             Show this help.
  -display DISPLAY  The X display to connect to.
  -border           The width of the border to put around the
                    system tray icons. Defaults to 1.
  -vertical         Line up the icons vertically. Defaults to
                    horizontally.
  -wmaker           WindowMaker mode. This makes docker a
                    fixed size (64x64) to appear nicely in
                    in WindowMaker.
                    Note: In this mode, you have a fixed
                    number of icons that docker can hold.
  -iconsize SIZE    The size (width and height) to display
                    icons as in the system tray. Defaults to
                    24.
  -color COLOR      The background color to use for the tray.
                    Defaults to whatever color the window
                    manager specifies.
make: *** [build] Error 1 «
2 comments
7 years agoRobert Cowham created PSLA-2 for perforce-software-log-analyzer:
Detect server=1 log files where there are no completed records.
Add a comment
7 years agoC. Thomas Tyler created PSLA-1 for perforce-software-log-analyzer:
Release the PSLA in The Workshop.
Add a comment
7 years agoRobert Cowham committed change 23683 into main
Bring in latest changes - performance improvements
Add a comment
7 years agoRobert Cowham committed change 23636 into main
Merge in latests changes to log2sql.py
- much faster
- better at detecting completed commands and out of order vtrack
- full test harness
Add a comment
7 years agoRobert Cowham committed change 23635 into main
Branch in tests
Add a comment
8 years agoRobert Cowham committed change 22465 into perforce-software-p4transfer:main, perforce-software-log-analyzer:main
Added tests for r99.2 created depot (no filesize/digest stored)
Fixed problem with preview failing comparison
Add --p4d option to tests to use differ...ent p4d version «
Add a comment
10 years agoLester Cheung committed change 15082 into main
README for the log analyzers.
Add a comment
10 years agoCharlie McLouth commented on review 11090 for main

@lester_cheung any nay or yay on this?

4 comments
10 years agoCharlie McLouth requested review 11090 for main
cmclouth improvements #review @lester_cheung
* Resolved whitespace indentation problems that prevent it from working on Windows.
* Converted to Pytho...n 3.x
** convert print to print()
** convert iteritems() to items()
** change exception handling
** cast float to int (line 175)
* Changed Table sort to consider the combination of both ReadWaitTime and WriteWaitTime (line 423.) «
4 comments
10 years agoLester Cheung committed change 10726 into main
Little changes that we have made over the last 2 years ^_^
Add a comment