Commit Graph

136 Commits

Author SHA1 Message Date
Lawrence, Rendall
57d9c8e78e clear store error in responseHook if ErrResourceDoesNotExist appear 2022-04-14 01:52:52 +03:00
Lawrence, Rendall
781fa9440f (done) replace redigo with go-redis
* replace redis keys with RawString encoded values (delete SerializedPeer)
* merge peers got from pre-hools with store data
2022-04-14 01:13:18 +03:00
Lawrence, Rendall
1fcddf5102 (WIP) replace redigo with go-redis 2022-04-13 01:12:00 +03:00
Lawrence, Rendall
c9e0af8b1e fix lint errors 2022-04-12 21:48:54 +03:00
Lawrence, Rendall
64eaf9d733 Fix lint gosec and ifshort issues 2022-04-12 18:51:03 +03:00
Lawrence, Rendall
554ae6fcd6 Reformat comments 2022-04-12 18:32:17 +03:00
Lawrence, Rendall
c1956d68f6 Remove YAML/MD lint configs, reformat stdlib imports 2022-04-12 18:10:51 +03:00
Širhoe Biazhkovič
c7edbb52f2 Merge commits 129aac230aa..828edb8fd8b from https://github.com/chihaya/chihaya 2022-04-12 15:58:14 +03:00
Lawrence, Rendall
4dbbb4ad83 Rename to MoChi 2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
d438ad58fe Test v2 hashes with qbt 2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
360ac9d08d Add man to exported functions/fields 2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
0a5ac35c4d Fix e2e execution, append 2to1 hash in approvals, update dependencies 2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
9122aefdd7 Fix storage tests
* reformat sources #JR1356
2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
beb4736b86 Implement simple PGDC methods for storage
* sanitize code a little
* move e2e build to 'e2e' tag
2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
566d99fcd7 Gegin work on shared store for handlers 2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
af1cbc543c Don't return error while converting hash to v1
Mark clientapproval as broken because of incorrect client_id parsing
2021-12-21 15:24:25 +03:00
Širhoe Biazhkovič
2f092bad45 Initial torrentV2 hash support 2021-12-21 15:24:11 +03:00
Širhoe Biazhkovič
823b92fe83 Disable prometheus fot in-memory store if period set to 0 2021-10-20 17:16:11 +03:00
Širhoe Biazhkovič
8580bb37e0 WIP Add support for custom torrents' approval storages
* migrate torrentapproval to list storage
* add initial support for torrent file storage (watch directory with fsnotify)
* replace frontend/http/bencode package with github.com/zeebo/bencode module
* sanitize code (fix warnings)

TODO:
* parse torrent files to get hashes,
* watch directory event types

DON'T use for now
2021-09-04 01:49:01 +03:00
Jimmy Zelinskie
3e334b9536 storage: remove memorybysubnet
This code, while interesting, was only relevant to Facebook and they use
their own fork that they maintain. There was not enough outside
interest to warrant maintaining. I'd rather us use the effort to support
a redis storage backend instead.
2019-02-13 19:44:04 -05:00
Jimmy Zelinskie
dc753b937c vendor: move to Go modules for dependencies
Fixes #444.
2019-02-12 20:36:25 -05:00
onestraw
e83f68b952 storage/redis: add exiting info
Change-Id: I7876bf420a35b48314d14925f5f2ae591fa2d243
2019-01-28 15:18:21 +08:00
onestraw
9d22b67f74 storage/redis: use redis reply
Change-Id: If6e6c2545b12c249413d3d13ea41e127b8d1d9b0
2019-01-21 19:44:33 +08:00
onestraw
fa19ffd050 add @mrd0ll4r 's comments
Change-Id: I53616703394f889fa2d0a4e952ac857d99c85218
2019-01-20 17:02:05 +08:00
onestraw
f2ab706f10 fix hlen/hdel race condition
Change-Id: Ib82e6e9f0c66d2df80d68fd00e0c6ec6b46a037b
2019-01-16 19:09:39 +08:00
onestraw
d65ab677e7 storage/redis: refactor redis storage
- Based on @duyanghao's PR
  - Make staticcheck pass
  - Address review commentsq
2019-01-04 13:58:20 +08:00
duyanghao
e78892d5ac Add Support for Redis Storage Backend(To Achieve Chihaya High Availability)
Change-Id: I5cf703095d1060ac17e403b86056d3eccad97f2c
Signed-off-by: duyanghao <1294057873@qq.com>
2019-01-03 17:21:13 +08:00
onestraw
e09d11e4b9 fix goimports error
Change-Id: I0f6e383ec1081cc47c690fdaab3fd35590a2634b
2018-12-17 16:59:44 +08:00
Justin Li
3c80ed8a8e Fix goimports violations 2018-10-24 09:25:03 -04:00
Justin Li
d95120c817 Return []error from Stop() channel, allow recursive stop groups 2018-09-09 11:30:15 -04:00
Jimmy Zelinskie
84ee1d6658 storage/memorybysubnet: fix mispellings 2018-06-15 13:33:26 -04:00
Jimmy Zelinskie
3c052ec98d storage/memory: multi-line call to New() 2018-06-15 13:33:26 -04:00
Jimmy Zelinskie
7dbbc86380 middleware: add a registration model 2017-12-29 16:55:48 -05:00
Leo Balduf
6198491194 storage: document PeerStore in more detail 2017-12-02 22:41:56 +01:00
Leo Balduf
89bc479a3b *: make use of timecache 2017-10-15 20:05:39 +02:00
Leo Balduf
b5dda16706 storage: stop peer store after tests 2017-09-13 03:47:19 +02:00
mrd0ll4r
4f4495f0f3 Merge pull request #350 from mrd0ll4r/benchmark-scrapes
storage: add Benchmarks for ScrapeSwarm, optimize implementations
2017-08-30 19:34:55 +02:00
Leo Balduf
5400a99b75 storage: add Benchmarks for ScrapeSwarm, optimize implementations 2017-08-30 08:54:11 +02:00
Leo Balduf
8ee8793867 storage: update benchmark config 2017-08-25 19:41:41 +02:00
Leo Balduf
df7b59e2f3 storage: add PeerLifetime to test config 2017-08-17 23:35:20 +02:00
Leo Balduf
8ed171b0ea pkg/log: create wrapper around logrus 2017-06-26 20:46:40 +02:00
Leo Balduf
1aa6c86d3f storage: update config defaults 2017-06-25 19:04:24 +02:00
Jimmy Zelinskie
dab03f52dc storage: share prometheus models
Running of the binary actually caused a panic due to multiple calling of
MustRegister(). This fixes that by sharing models in the storage
package.
2017-06-05 22:07:13 -04:00
Jimmy Zelinskie
c41519e73f storage: sync memory & memorybysubnet
This change is a manual merge of all of the optimizations that have been
added to the memory peer store into the memorybysubnet peer store.

This also fixes some inconsistencies between the two.
2017-06-04 16:42:32 -04:00
Jimmy Zelinskie
7786e1a915 storage: enforce all peer stores are loggable 2017-06-04 16:06:01 -04:00
Jimmy Zelinskie
85d7d9c677 storage/memorybysubnet: bench with masks 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
acf7e3c749 storage: register unique Prometheus metrics names 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
039f25f571 storage/memorybysubnet: add peerSubnet type 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
b013106f89 storage/memorybysubnet: delete empty subnet buckets 2017-06-03 15:47:58 -04:00
Jimmy Zelinskie
cb6a3be2ac storage/memorybysubnet: s/mask/preferredSubnet 2017-06-03 15:47:58 -04:00