Upvote Upvoted 26 Downvote Downvoted
TF2 Stats - Aggregated stats for comp matches
posted in Projects
1
#1
0 Frags +

Link to the project: http://stats.playcomp.tf/players/

What is TF2 Stats
TF2 Stats is a website for aggregated statistics for competitive matches. This allows to regroup in one place, all of a tournament's logs for easy finding. Aggregating logs also has the benefit of understanding stats from a bird's eye view, instead of localised to a single match. With that, you can understand how trends have changed across the seasons, how a team's play style varies from another or even what European players' weapons of choice are compared to their Australian counterpart.

Here's an example of data from an entire season of league play: http://i.imgur.com/5kKumIZ.png

How long has this project been going
TF2 Stats has been around quite a while. It was first available for UGC Highlander (July 2015), then ESEA 6s (January 2016, no longer maintained due to CloudFlare DDoS protection) and now RGL Highlander. The plus sides of integrating with those leagues is that 1) I'm more familiar with NA leagues and 2) They had an API which is practical to get data on matches, team & roster information, etc.

What's new in 2018
The website was dead for the past few seasons and I revived it recently for RGL Highlander. Across the years, the structure of the website has changed and it would now be possible to generalise the data in order to support other tournaments. For example, even if I-Series don't have an API, it would still possible to type in manually division & team names and associate them with logs. Some features wouldn't be available but still, it'd be nice to regroup logs from big events in one place, instead of them being lost forever or having to do this: http://logs.tf/1817404

What's the current status
I'm currently looking to get a pulse of the situation and see whether people would be interested in seeing this happen. This would take some time to implement and if this is too much of a niche need that would only be used by a few people, it would unfortunately not be a good time investment. If people are interested, would anyone be willing to upload those logs or would you be more interested in only viewing the content once available? I believe the website would be ideal for LAN Events, Insomnia Series, cups or even bigger events such as ETF2L & ozfortress seasons.

-------

This thread will also be used to gather feedback if this moves forward. I'm not as familiar with the 6s scene and am looking forward to see what kind of stats would benefit the community.

Cheers!

Link to the project: http://stats.playcomp.tf/players/

[b]What is TF2 Stats[/b]
TF2 Stats is a website for aggregated statistics for competitive matches. This allows to regroup in one place, all of a tournament's logs for easy finding. Aggregating logs also has the benefit of understanding stats from a bird's eye view, instead of localised to a single match. With that, you can understand how trends have changed across the seasons, how a team's play style varies from another or even what European players' weapons of choice are compared to their Australian counterpart.

Here's an example of data from an entire season of league play: http://i.imgur.com/5kKumIZ.png

[b]How long has this project been going[/b]
TF2 Stats has been around quite a while. It was first available for UGC Highlander (July 2015), then ESEA 6s (January 2016, no longer maintained due to CloudFlare DDoS protection) and now RGL Highlander. The plus sides of integrating with those leagues is that 1) I'm more familiar with NA leagues and 2) They had an API which is practical to get data on matches, team & roster information, etc.

[b]What's new in 2018[/b]
The website was dead for the past few seasons and I revived it recently for RGL Highlander. Across the years, the structure of the website has changed and it would now be possible to generalise the data in order to support other tournaments. For example, even if I-Series don't have an API, it would still possible to type in manually division & team names and associate them with logs. Some features wouldn't be available but still, it'd be nice to regroup logs from big events in one place, instead of them being lost forever or having to do this: http://logs.tf/1817404

[b]What's the current status[/b]
I'm currently looking to get a pulse of the situation and see whether people would be interested in seeing this happen. This would take some time to implement and if this is too much of a niche need that would only be used by a few people, it would unfortunately not be a good time investment. If people are interested, would anyone be willing to upload those logs or would you be more interested in only viewing the content once available? I believe the website would be ideal for LAN Events, Insomnia Series, cups or even bigger events such as ETF2L & ozfortress seasons.

-------

This thread will also be used to gather feedback if this moves forward. I'm not as familiar with the 6s scene and am looking forward to see what kind of stats would benefit the community.

Cheers!
2
#2
9 Frags +

that graphic you have for ugc hl is really cool and seeing something for 6s would be amazing.

that graphic you have for ugc hl is really cool and seeing something for 6s would be amazing.
3
#3
5 Frags +

Honestly looks pretty cool! What is the approximate workload for collating all the logs for a particular season?

Honestly looks pretty cool! What is the approximate workload for collating all the logs for a particular season?
4
#4
10 Frags +
glassthat graphic you have for ugc hl is really cool and seeing something for 6s would be amazing.

It would have been really cool to do this for ESEA. Unfortunately, not only are their stats limited but it's also become impossible to scrape the data. It would definitely be possible to do it for other events and non-american leagues however :)

oblaHonestly looks pretty cool! What is the approximate workload for collating all the logs for a particular season?

This has been the biggest struggle when it comes to this project. Uploading a combined log takes about 5-10 seconds on the website, but actually finding them and remaining up to date is another story. For RGL Highlander this season, all the Invite logs were listed in articles so it only took a few minutes. For the remaining divisions, I had the help of Bliztank and a few other players. I believe it took them a few hours a night for 2 days.

What I find exciting is that it's RGL HL's first season, so it's easier and motivating now to keep on doing it. This is less daunting then if we were to say, for example.. Ok, let's find all the logs for each I-Series for the past few years.

This is also one of the reasons why I asked if anyone would actually be passionate enough to collect logs. If no one is willing to, then it's unfortunately not worth it. Consistency in statistics is the key in making this website successful. Otherwise, the data's integrity is lost and the data becomes meaningless. The work of looking for logs has very little reward and can be frustrating, as logs are all over the place, sometimes mixed up, sometimes missing supplemental stats.. But in a way, this also demonstrates that this project is badly needed, as otherwise, the logs just get lost forever.

[quote=glass]that graphic you have for ugc hl is really cool and seeing something for 6s would be amazing.[/quote]

It would have been really cool to do this for ESEA. Unfortunately, not only are their stats limited but it's also become impossible to scrape the data. It would definitely be possible to do it for other events and non-american leagues however :)

[quote=obla]Honestly looks pretty cool! What is the approximate workload for collating all the logs for a particular season?[/quote]

This has been the biggest struggle when it comes to this project. Uploading a combined log takes about 5-10 seconds on the website, but actually finding them and remaining up to date is another story. For RGL Highlander this season, all the Invite logs were listed in articles so it only took a few minutes. For the remaining divisions, I had the help of Bliztank and a few other players. I believe it took them a few hours a night for 2 days.

What I find exciting is that it's RGL HL's first season, so it's easier and motivating now to keep on doing it. This is less daunting then if we were to say, for example.. Ok, let's find all the logs for each I-Series for the past few years.

This is also one of the reasons why I asked if anyone would actually be passionate enough to collect logs. If no one is willing to, then it's unfortunately not worth it. Consistency in statistics is the key in making this website successful. Otherwise, the data's integrity is lost and the data becomes meaningless. The work of looking for logs has very little reward and can be frustrating, as logs are all over the place, sometimes mixed up, sometimes missing supplemental stats.. But in a way, this also demonstrates that this project is badly needed, as otherwise, the logs just get lost forever.
5
#5
3 Frags +

this is awesome! it would be really cool to see it expanded to other leagues like ETF2L if possible too

this is awesome! it would be really cool to see it expanded to other leagues like ETF2L if possible too
6
#6
2 Frags +

We love you Mamboulay. More than you know.

We love you Mamboulay. More than you know.
7
#7
3 Frags +

MAMBOULAY!!!

Man it's been a long time since I've seen you. I was very sad to see your site not working/being used the last couple seasons of UGC I played. Glad to see it's back.

MAMBOULAY!!!

Man it's been a long time since I've seen you. I was very sad to see your site not working/being used the last couple seasons of UGC I played. Glad to see it's back.
8
#8
2 Frags +

spades
the template of a engie main

spades
the template of a engie main
9
#9
2 Frags +

Nice work! Glad to see it's being updated again!!

Nice work! Glad to see it's being updated again!!
10
#10
3 Frags +

So you're saying that the website only takes in specially formatted logs that you have to collect yourself, and not that the website does it automatically for you, correct? If it were the latter, I could definitely use it for my lan analysis articles to save myself the trouble of multiple hours of manual stat collecting. Nobody should ever have to go through that experience...

So you're saying that the website only takes in specially formatted logs that you have to collect yourself, and not that the website does it automatically for you, correct? If it were the latter, I could definitely use it for my lan analysis articles to save myself the trouble of multiple hours of manual stat collecting. Nobody should ever have to go through that experience...
11
#11
2 Frags +

It's great to see the familiar faces :)

Joe_ShroeSo you're saying that the website only takes in specially formatted logs that you have to collect yourself, and not that the website does it automatically for you, correct? If it were the latter, I could definitely use it for my lan analysis articles to save myself the trouble of multiple hours of manual stat collecting. Nobody should ever have to go through that experience...

The website takes logs from Logs.TF and validates that they have supplemental stats (damage, damage taken, heals, weapon stats, etc.). The logs are not found automatically unfortunately, especially if it's for LANs, for which there's no roster or match API. But the data is gathered from the Logs.TF API. Once a log link is provided, it just slurps all the data into a database and the queries/aggregates are made using that database (so it's not via a spreadsheet if that's what you mean by manual stat collecting).

It's great to see the familiar faces :)

[quote=Joe_Shroe]So you're saying that the website only takes in specially formatted logs that you have to collect yourself, and not that the website does it automatically for you, correct? If it were the latter, I could definitely use it for my lan analysis articles to save myself the trouble of multiple hours of manual stat collecting. Nobody should ever have to go through that experience...[/quote]

The website takes logs from Logs.TF and validates that they have supplemental stats (damage, damage taken, heals, weapon stats, etc.). The logs are not found automatically unfortunately, especially if it's for LANs, for which there's no roster or match API. But the data is gathered from the Logs.TF API. Once a log link is provided, it just slurps all the data into a database and the queries/aggregates are made using that database (so it's not via a spreadsheet if that's what you mean by manual stat collecting).
12
#12
1 Frags +

I have uploaded the Rewind II logs to give you an idea of what it looks like: http://stats.playcomp.tf/tournaments/rewind/teams

For reference, it took a around 1 hour to upload all of the logs. I would lose my mind if I were to do this over and over, which is why I was wondering if people would be interested in helping. If so, I would make the upload interface more user-friendly and would start adapting the stats for 6s format.

I have uploaded the Rewind II logs to give you an idea of what it looks like: http://stats.playcomp.tf/tournaments/rewind/teams

For reference, it took a around 1 hour to upload all of the logs. I would lose my mind if I were to do this over and over, which is why I was wondering if people would be interested in helping. If so, I would make the upload interface more user-friendly and would start adapting the stats for 6s format.
Please sign in through STEAM to post a comment.