40b0870cf8
fix linting ( #4 )
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-11-03 01:08:23 +03:00
14c97d59c1
many improvements with options and noop stuff
...
* add many options helpers
* fix noop client to allow publish messages to topic in broker
* fix noop server to allow registering in registry
* fix noop server to allow subscribe to topic in broker
* fix new service initialization
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-10-16 09:38:57 +03:00
6021edc855
add more context to store
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-09-17 15:18:01 +03:00
8817c110d0
add context to store
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-09-17 15:15:42 +03:00
c576749b57
noop impl ( #32 )
...
* improve logger usage
* add noop client and server
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-09-05 02:11:29 +03:00
c062aab1a9
add noop broker and noop store ( #30 )
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-09-03 15:11:05 +03:00
53654185ba
add logger to options
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-29 17:44:49 +03:00
7cf42589b3
cleanup deps
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-28 11:52:51 +03:00
8076e410a9
fix repocard issues ( #20 )
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-25 14:33:36 +03:00
0f4b1435d9
move implementations to external repos ( #17 )
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-25 13:44:41 +03:00
c4a303190a
lint fixes ( #14 )
...
* lint fixes
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-21 14:53:21 +03:00
199ff66bd4
enable cache for build, closes #8 ( #12 )
...
* enable cache for build, closes #8
* goimports
* lint fixes
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-20 15:23:41 +03:00
0a42845a40
fix tests
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-20 14:20:27 +03:00
Dominic Wong
d5da9c0728
Unify the store tests ( #1952 )
...
Add more tests for store
2020-08-20 14:20:12 +03:00
06136312bb
regen files with never protoc ( #6 )
...
* regen files with never protoc
* rewrite import path
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-08-19 17:47:17 +03:00
Dominic Wong
2eac8ed64f
Fix cockroach store not respecting WriteTTL option ( #1943 )
...
* cockroach fixes for expiry
* cockroach should run in the background
2020-08-18 18:30:05 +01:00
Asim Aslam
1fa3ac5599
write nil when expiry is zero
2020-08-12 12:52:14 +01:00
Dominic Wong
69a53e8070
expiry can be taken from options or record ( #1928 )
2020-08-11 18:11:18 +01:00
Asim Aslam
563768b58a
v3 refactor ( #1868 )
...
* Move to v3
Co-authored-by: Ben Toogood <bentoogood@gmail.com>
2020-07-27 13:22:00 +01:00
Dominic Wong
9dfeb98111
cockroach typo in init ( #1872 )
2020-07-27 10:16:40 +01:00
ben-toogood
68927e875b
store/service: use client passed in Init options ( #1843 )
2020-07-15 14:01:33 +01:00
Alex Unger
42c28f2b6d
Fix Comments ( #1833 )
...
* update store url
* fix leftover copy paste
2020-07-14 13:13:32 +01:00
Janos Dobronszki
3f4b58b58c
Let bolt do locking per each List Get etc op, instead of managing fil… ( #1831 )
2020-07-14 10:35:46 +02:00
Lars Lehtonen
2b033b6495
store/cockroach: fix dropped errors ( #1796 )
...
Co-authored-by: Asim Aslam <asim@aslam.me>
2020-07-06 20:14:36 +01:00
Dominic Wong
5967a68e78
cached file store ( #1739 )
...
* cached file store
2020-06-26 16:13:53 +01:00
ben-toogood
58c6bbbf6b
registry/service: pass domain options via rpc ( #1719 )
...
* registry/service: regenerate proto
* registry/service: pass domain in proto request options
* registry/service: stop defaulting metadata
* registry: add default domain const; remove from implementations
* registry/memory: fix typo
2020-06-19 10:34:12 +01:00
Dominic Wong
aec27be9b4
Fix race when opening DB for first time ( #1691 )
2020-06-12 10:42:52 +01:00
Asim Aslam
7b379bf1f1
WIP: Add metadata to store record ( #1604 )
...
* Add metadata to store record
* Add metadata to cockroach store
* add metadata to store service implementation
* fix breaking cache test
* Test/fix cockroach metadata usage
* fix store memory metadata bug
2020-06-03 09:45:08 +01:00
Asim Aslam
6a661fd08c
check if the db conn is nil before doing anything ( #1652 )
2020-05-20 14:03:38 +01:00
Ben Toogood
410fec8ee4
Fix auth bug
2020-05-13 16:49:17 +01:00
Ben Toogood
efb64b7dbb
Pass client to more of the runtime
2020-05-11 17:57:39 +01:00
Ben Toogood
506006f0fa
Auth Options
2020-05-11 11:47:59 +01:00
ben-toogood
5387f73b5d
Handle cockroach createDB error ( #1603 )
2020-05-06 10:58:14 +01:00
Asim Aslam
08a2de1ef5
Account for missing options database/table in cockroach store
2020-05-01 15:31:55 +01:00
Asim Aslam
7a2dea6cc2
Set database/table from init first
2020-05-01 15:22:44 +01:00
Asim Aslam
e8105d22ad
cruft
2020-05-01 00:25:17 +01:00
Asim Aslam
c76a5e608d
sql fixes
2020-04-30 23:53:54 +01:00
Asim Aslam
359b8bc503
Add opts to service proto ( #1517 )
...
* Add opts to service proto
* Support database/table opts
2020-04-30 22:51:25 +01:00
268651df18
regenerate all proto based files ( #1531 )
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-04-14 16:25:09 +03:00
Asim Aslam
51d4f737b8
fixup store cache#
2020-04-11 12:10:19 +01:00
Asim Aslam
3f81f685df
Move sync
2020-04-11 12:00:34 +01:00
Asim Aslam
bb1ccf09e8
prefix store dir
2020-04-11 11:23:41 +01:00
Asim Aslam
6d553cb6fe
add whitespace
2020-04-11 09:34:04 +01:00
Asim Aslam
c612d86480
Move sync store
2020-04-11 09:33:10 +01:00
Asim Aslam
d4b2c948dd
Remove cloudflare store
2020-04-10 19:50:57 +01:00
Asim Aslam
57853b2849
remove etcd store
2020-04-10 17:43:02 +01:00
Jake Sanders
6a666c9c7d
Add json tags to store.Record ( #1518 )
2020-04-09 19:38:43 +01:00
Asim Aslam
53549b6b30
Add options for Database/Table ( #1516 )
...
* Add options for Database/Table
* fix opts
2020-04-09 17:56:13 +01:00
Jake Sanders
0a27a08184
Add Databases and Tables endpoints to store RPC proto ( #1515 )
...
* Add Databases and Tables to store RPC
* add Database to TablesRequest
2020-04-09 16:37:32 +01:00
8c1b477279
store/cockroach: fixup test ( #1512 )
...
* store/cockroach: fixup test
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-04-09 14:58:50 +03:00
Jake Sanders
2e379ca7d0
Don't break the build!
2020-04-09 12:18:02 +01:00
Jake Sanders
2659215d5e
cockroachDB doesn't support this syntax ( #1509 )
2020-04-09 12:11:24 +01:00
1063b954de
dont display t.Log/t.Logf as errors in github actions ( #1508 )
...
* fix tests and github action annotations
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-04-09 14:05:46 +03:00
Jake Sanders
1e7cd8c484
Make the constraint explicit rather than inferred ( #1506 )
2020-04-08 23:52:35 +01:00
Asim Aslam
45700eaabe
set database/table in header
2020-04-08 19:25:57 +01:00
Jake Sanders
77f5cc5023
Fix nil dereference in cloudflare store ( #1504 )
2020-04-08 13:00:30 +01:00
Jake Sanders
cc027d900e
Close statements, add default table if the store was not initialised through service.Init() ( #1502 )
2020-04-08 12:08:08 +01:00
Asim Aslam
98fc3dfbad
use single data bucket
2020-04-08 09:57:51 +01:00
Asim Aslam
4b0e27413e
add Store Close method ( #1500 )
...
* add Store Close method
* Update sync store build failure
2020-04-08 09:51:10 +01:00
Asim Aslam
4cac7dcc48
fix file tests
2020-04-07 19:45:27 +01:00
Janos Dobronszki
038b936ce9
Setting up file store in constructor and not in init which is o… ( #1499 )
2020-04-07 16:43:43 +02:00
Janos Dobronszki
aaee01b1a7
Use file store by default (as opposed to memory store) ( #1498 )
...
* Use file store by default (as opposed to memory store)
* Default table for file store
2020-04-07 15:19:45 +02:00
Jake Sanders
71538adfdc
Explicitly set the table name during service init ( #1497 )
2020-04-07 13:00:05 +01:00
Janos Dobronszki
2ea5b33955
Disk backed local store ( #1491 )
2020-04-07 13:53:22 +02:00
Asim Aslam
b5f5027549
Move store scope to util
2020-04-07 02:23:16 +01:00
Jake Sanders
3324d140c0
Rename store Namespace / Prefix options to Database and Table ( #1492 )
...
* Rename Namespace to DB, Rename Prefix to table, Remove Suffix Option
* Rename options
* Rename options
* Add store_table option
* Table per service, not Database per service
2020-04-06 16:45:55 +01:00
Asim Aslam
0a15ae9b9d
Move String method ( #1467 )
2020-04-01 23:27:15 +01:00
Asim Aslam
e1bc0f6288
replace strings for store prefix ( #1465 )
...
Co-authored-by: ben-toogood <bentoogood@gmail.com>
2020-04-01 20:19:21 +01:00
9e6db79860
regenerate all proto ( #1440 )
...
* regenerate all proto
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* regenerate from proto
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* regenerate from proto
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-03-30 21:58:32 +01:00
Lars Lehtonen
011a783a9e
store/cockroach: fix dropped test errors ( #1419 )
...
Co-authored-by: Asim Aslam <asim@aslam.me>
2020-03-27 10:15:37 +00:00
Jake Sanders
dff98355be
Missing ; in SQL query
2020-03-24 23:49:09 +00:00
Jake Sanders
397a8638f4
Cockroach Store bugfix ( #1401 )
2020-03-24 17:16:38 +00:00
Jake Sanders
eb4d2ae6aa
Remove useless variable from cockroach store ( #1400 )
2020-03-24 15:37:30 +00:00
Jake Sanders
914340585c
Trim space from env variables ( #1399 )
2020-03-24 14:51:43 +00:00
Jake Sanders
4c6f68d537
Implement store read cache ( #1366 )
...
* Implement store read cache
* Added cache tests and fixed a bug in memory store
2020-03-19 18:19:07 +00:00
Jake Sanders
c91bf7e9e7
[WIP] Store Sync ( #1365 )
...
* Initial cache implementation
* Write queue implementation
* Accidentally started writing the storage sync service
2020-03-18 16:39:36 +00:00
Jake Sanders
638c219736
Cockroach store feature completion ( #1358 )
...
* Start fixing cockroach store
* Add prefix, suffix, limit, offset for cockroachdb store
2020-03-17 16:15:23 +00:00
ab73127063
grpc client/server fixes ( #1355 )
...
* grpc client/server fixes
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-03-17 14:27:20 +03:00
ben-toogood
247707f583
Return store.ErrNotFound if not found when calling over rpc ( #1353 )
...
Co-authored-by: Ben Toogood <ben@micro.mu>
2020-03-16 10:30:56 +00:00
Asim Aslam
e803fb0855
Runtime hacks ( #1344 )
...
* Add Args/Image to runtime
* remove the hacks
2020-03-13 18:39:59 +00:00
Asim Aslam
078dd4eb9b
fix etcd ( #1340 )
...
* fix etcd
* update go mod
2020-03-13 08:55:23 +00:00
Jake Sanders
1b4e881d74
Rewrite the store interface ( #1335 )
...
* WIP store rewrite
* Fix memory store tests
* Store hard expiry times rather than duration!
* Clarify memory test
* Add limit to store interface
* Implement suffix option
* Don't return nils from noop store
* Fix syncmap
* Start fixing store service
* wip service and cache
* Use _ for special characters in cockroachdb namespace
* Improve cockroach namespace comment
* Use service name as default store namespace
* Fixes
* Implement Store Scope
* Start fixing etcd
* implement read and write with expiry and prefix
* Fix etcd tests
* Fix cockroach store
* Fix cloudflare interface
* Fix certmagic / cloudflare store
* comment lint
* cache isn't implemented yet
* Only prepare DB staements once
Co-authored-by: Ben Toogood <ben@micro.mu>
Co-authored-by: ben-toogood <bentoogood@gmail.com>
2020-03-12 13:41:30 +00:00
Asim Aslam
1ca4619506
return store.ErrNotFound ( #1332 )
2020-03-11 23:09:42 +00:00
7b385bf163
minimize allocations in logger and tunnel code ( #1323 )
...
* logs alloc
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* fix allocs
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* fix allocs
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* tunnel allocs
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* try to fix tunnel
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* cache cipher for send
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* more logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-03-11 17:55:39 +00:00
Jake Sanders
3f0c28a815
Expiration is actually a unix timestamp ( #1290 )
...
* Expiration is actually a unix timestamp
* int -> int64
2020-03-03 18:15:50 +00:00
Jake Sanders
beb5e80e87
Fix nil pointer dereference ( #1289 )
2020-03-03 13:54:56 +00:00
Jake Sanders
eebd69c995
Change from renekroon/ttlcache to patrickmn/go-cache ( #1288 )
2020-03-03 13:35:49 +00:00
Jake Sanders
bc71989e2c
int64 -> time.Duration ( #1287 )
2020-03-03 13:15:26 +00:00
Jake Sanders
f6102bde70
Add a cache to workers KV storage implementation ( #1284 )
...
* cloudflare-cache
* go mod tidy
2020-03-02 18:14:25 +00:00
ben-toogood
9200c70202
Replace validation error with regex for cockroach namespace ( #1270 )
...
Co-authored-by: Asim Aslam <asim@aslam.me>
2020-03-01 22:09:06 +00:00
117f56ebf7
prune util/log and user logger ( #1237 )
...
* prune util/log and user logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* plaintext logger
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
* add newline
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-02-23 13:45:20 +00:00
ben-toogood
d621548120
Auth ( #1147 )
...
Implement the Auth interface, with JWT and service implementations.
* Update Auth Interface
* Define Auth Service Implementation
* Support Service Auth
* Add Auth Service Proto
* Remove erronious files
* Implement Auth Service Package
* Update Auth Interface
* Update Auth Interface. Add Validate, remove Add/Remove roles
* Make Revoke interface more explicit
* Refactor serializing and deserializing service accounts
* Fix srv name & update interface to be more explicit
* Require jwt public key for auth
* Rename Variables (Resource.ID => Resource.Name & ServiceAccount => Account)
* Implement JWT Auth Package
* Remove parent, add ID
* Update auth imports to v2. Add String() to auth interface
2020-02-03 08:16:02 +00:00
f23638c036
fix import paths for v2 release
...
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
2020-01-30 14:44:40 +03:00
shu xian
101017a29c
cockroach supports URL connection string
2020-01-29 00:47:41 +08:00
Asim Aslam
6ca298c61d
set default store, fix store options bug, add String method
2020-01-10 19:13:55 +00:00
Asim Aslam
a90a74c9e2
Change the store interface to remove variadic args ( #1095 )
2020-01-08 22:23:14 +00:00
Asim Aslam
048065fe96
support ability to set store, address and namespace via flags and env vars ( #1092 )
2020-01-08 12:11:31 +00:00
Asim Aslam
be6e8a7c78
add store to defaults ( #1086 )
2020-01-06 17:44:32 +00:00
Jake Sanders
55f5937c8b
Remove debug
2019-12-16 17:16:10 +00:00
Jake Sanders
56619f2745
Fix cockroachdb store implemetation
2019-12-16 17:11:13 +00:00
