Honestly I'm so glad logs is down right now, saved me from an appearance in the 98dpm thread lmao
Logs.tf match stats
posted in
Projects
Hello, I wanted to ask how much data is currently stored on logs.tf. I'm working on a software project that utilizes logs.tf, and it would be very helpful to know whether it is feasible to essentially store all of logs.tf in my own database in order to get around the rate limiting, or if I should just stick to storing only crucial data for each log in my database on demand.
Hello, I wanted to ask how much data is currently stored on logs.tf. I'm working on a software project that utilizes logs.tf, and it would be very helpful to know whether it is feasible to essentially store all of logs.tf in my own database in order to get around the rate limiting, or if I should just stick to storing only crucial data for each log in my database on demand.
just take the average log size * the number of logs (which is prominently displayed on the logs.tf front page)
just take the average log size * the number of logs (which is prominently displayed on the logs.tf front page)
hYm3nSl4yrjust take the average log size * the number of logs (which is prominently displayed on the logs.tf front page)
Taking a sample of 100 random serveme logs, 172MB uncompressed.
So probably something approaching 7TB uncompressed for all of logs.tf, but if you compress it with something quick and good like zstd, TF2 logs shrink over 20x, so you'll need 300GB of space or so.
[quote=hYm3nSl4yr]just take the average log size * the number of logs (which is prominently displayed on the logs.tf front page)[/quote]
Taking a sample of 100 random serveme logs, 172MB uncompressed.
So probably something approaching 7TB uncompressed for all of logs.tf, but if you compress it with something quick and good like zstd, TF2 logs shrink over 20x, so you'll need 300GB of space or so.
Taking a sample of 100 random serveme logs, 172MB uncompressed.
So probably something approaching 7TB uncompressed for all of logs.tf, but if you compress it with something quick and good like zstd, TF2 logs shrink over 20x, so you'll need 300GB of space or so.
sirHello, I wanted to ask how much data is currently stored on logs.tf. I'm working on a software project that utilizes logs.tf, and it would be very helpful to know whether it is feasible to essentially store all of logs.tf in my own database in order to get around the rate limiting, or if I should just stick to storing only crucial data for each log in my database on demand.
The JSON data dump, usually sufficient enough, is ~115GB.
[quote=sir]Hello, I wanted to ask how much data is currently stored on logs.tf. I'm working on a software project that utilizes logs.tf, and it would be very helpful to know whether it is feasible to essentially store all of logs.tf in my own database in order to get around the rate limiting, or if I should just stick to storing only crucial data for each log in my database on demand.[/quote]
The JSON data dump, usually sufficient enough, is ~115GB.
The JSON data dump, usually sufficient enough, is ~115GB.
Please
sign in through STEAM
to post a comment.