unistack-org/micro
4
0
Fork 3
Code Issues 17 Pull Requests 1 Actions Packages Projects Releases 258 Wiki Activity
3,497 Commits 10 Branches 343 Tags 11 MiB
5f4491bb86
Commit Graph

50 Commits

Author SHA1 Message Date
Dominic Wong
7c5e3b0f30
report errors from log streaming (#1828) 2020-07-13 17:35:23 +01:00
ben-toogood
09ec20fded
runtime: provide credentials to services (#1817) 
* runtime: inject credentials into service

* util/auth: self generate accounts (needed for jwt)

* runtime/kubernetes: add logging for creds

* runtime/kubernetes: serialize secret name

* runtime/kubernetes: remove unused code

* runtime/kubernetes: base64 encode secret

* runtime/kubernetes: remove metadata from secret

* util/kubernetes/client: omit empty secret metadata

* util/kubernetes/client: fix secret template

* util/kubernetes/client: fix secrets

* web: update auth util

* util/auth: fix missing arg

* extend token expiry

* extend token expiry
 2020-07-10 16:25:46 +01:00
Janos Dobronszki
3c633e3577
Sparse checkout of repos, all repo downloads happen to different folders for concurrency support (#1779) 2020-07-02 14:40:40 +02:00
Dominic Wong
86dfcb819b Ignore "no such process" error (#1686) 
* Cleanup how status is updated for service. Ignore "no such process" error as it could be that the pid died

* add nice error log to record process error exit
 2020-06-12 10:42:52 +01:00
Ben Toogood
8875719619 Default Runtime multi-tenancy 2020-05-19 11:01:06 +01:00
Ben Toogood
c19b349e96 Update runtime.Event struct 2020-05-19 10:14:07 +01:00
Dominic Wong
05858b746c
kill all processes correctly for micro kill command (#1633) 2020-05-13 18:36:45 +01:00
Janos Dobronszki
0fb4734e67
Upload local source code to micro server (#1613) 2020-05-13 12:07:53 +02:00
Janos Dobronszki
da66561d1e
Fixing too large offsets for default runtime logs (#1587) 2020-04-28 13:42:15 +01:00
Janos Dobronszki
b875868a39
Don't ignore errors from checkout source code (#1584) 
Don't check out code for builtin services.
 2020-04-28 10:51:39 +02:00
Janos Dobronszki
8148e0a0f8
Micro log fixes (#1570) 2020-04-28 09:49:39 +02:00
Asim Aslam
0a030f3d8a strip unused list endpoint 2020-04-24 18:05:38 +01:00
Janos Dobronszki
ff8ad7d4ca
Default runtime now checks out code on demand (#1563) 
* Default runtime now checks out code on demand

* Go mod tidy
 2020-04-23 16:30:43 +02:00
ben-toogood
692b27578c
Runtime Namespace (#1547) 
* Add context option to runtime; Add dynamic namespace to kubectl client

* Add namespace runtime arg

* Fixes & Debugging

* Pass options in k8s runtime

* Set namespace on k8s resources

* Additional Logging

* More debugging

* Remove Debugging

* Ensure namespace exists

* Add debugging

* Refactor namespaceExists check

* Fix

* Fix

* Fix

* Fix

* Change the way we check for namespace

* Fix

* Tidying Up

* Fix Test

* Fix merge bugs

* Serialize k8s namespaces

* Add namespace to watch

* Serialize namespace when creating k8s namespace

Co-authored-by: Ben Toogood <ben@micro.mu>
Co-authored-by: Asim Aslam <asim@aslam.me>
 2020-04-23 13:53:42 +01:00
Janos Dobronszki
7c31edd5f8
Enabling default runtime to run multiple versions (#1545) 
* Enabling default runtime to run multiple versions

* Trigger build

* Fix

* Sprintf
 2020-04-20 15:54:29 +02:00
Janos Dobronszki
ac5822f1ee
Fix local runtime updates (#1543) 2020-04-16 17:50:24 +02:00
Asim Aslam
c878237567 fix log file creation 2020-04-11 11:22:02 +01:00
Asim Aslam
ac8b6f944e Prefix logs dir micro/logs for runtime 2020-04-11 11:15:01 +01:00
Asim Aslam
f2dd091ec0 strip log 2020-04-09 10:28:16 +01:00
Janos Dobronszki
2cafa289b6
Stop LogStream if there is an error in k8s pod log streaming (#1469) 
* Stop LogStream if there is an error in k8s pod log streaming

* Locking stream Stops

* PR comment
 2020-04-02 12:16:35 +01:00
Janos Dobronszki
d2b6d35220
log.Errorf when pod streaming fails (#1463) 
* log.Errorf when pod streaming fails

* Error method added for loggers

Co-authored-by: Asim Aslam <asim@aslam.me>
 2020-04-01 23:03:26 +01:00
Janos Dobronszki
bb51b8203e
Runtime logs (#1447) 
* Runtime logs

* Slightly broken

* Pushing for diff

* Log trailing works locally

* LogsOptions

* Comments and streamcount support for local logs

* Adding kubernetes logs

* Fixing k8s logs

* K8s fixes

* StreamCount is now nuked

* PR comments

* PR comments again

* Fix typo
 2020-04-01 15:40:15 +02:00
Asim Aslam
e49be1da42
fix local runtime (#1383) 2020-03-19 22:38:37 +00:00
Asim Aslam
e803fb0855
Runtime hacks (#1344) 
* Add Args/Image to runtime

* remove the hacks
 2020-03-13 18:39:59 +00:00
Vasiliy Tolstov
7b385bf163
minimize allocations in logger and tunnel code (#1323) 
* logs alloc

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* fix allocs

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* fix allocs

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* tunnel allocs

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* try to fix tunnel

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* cache cipher for send

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* more logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
 2020-03-11 17:55:39 +00:00
Vasiliy Tolstov
117f56ebf7
prune util/log and user logger (#1237) 
* prune util/log and user logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* plaintext logger

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>

* add newline

Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
 2020-02-23 13:45:20 +00:00
Asim Aslam
c7f075d157 rename file 2020-02-07 14:00:27 +00:00
ben-toogood
bf747a86f4
Runtime (#1160) 
* Add String to Runtime interface

* Setup Dynamic Runtime Configuration
 2020-02-05 13:59:35 +00:00
Vasiliy Tolstov
f23638c036 fix import paths for v2 release 
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
 2020-01-30 14:44:40 +03:00
Asim Aslam
be788415ad minor runtime fixes 2020-01-17 14:14:47 +00:00
Asim Aslam
491a42d352 Switch notifier to scheduler 2020-01-16 13:34:04 +00:00
Asim Aslam
2fe64001c0 Start runtime services inline 2019-12-24 17:51:30 +00:00
Asim Aslam
6e28e7a86f Save current state of the world 2019-12-11 14:37:03 +00:00
Vasiliy Tolstov
a1eaf9cc20 linting fixes 
Signed-off-by: Vasiliy Tolstov <v.tolstov@unistack.org>
 2019-12-04 00:22:02 +03:00
Asim Aslam
c3ed83dfba Support service types in runtime 2019-11-29 11:35:00 +00:00
Asim Aslam
6475c1f3ad Patch spec template annotations and use event timestmap 2019-11-26 17:33:41 +00:00
Asim Aslam
252667398e
Update the runtime for k8s name formatting and move Get to Read endpoint (#978) 
* Update the runtime for k8s name formatting and move Get to Read endpoint

* strip regex validation
 2019-11-25 16:31:14 +00:00
Milos Gajdos
97c1300f53 [WIP] Micro Runtime (#947) 
* Add Get() and GetOptions.

* Removed watcher. Outline of client. YAML templates

* Added default service and deployment templates and types

* Added API tests and cleaned up errors.

* Small refactoring. Template package is no more.

* Ripped out existing code in preparation to small rework

* Reshuffled the source code to make it organized better

* Create service and deployment in kubernetes runtime

* Major cleanup and refactoring of Kubernetes runtime

* Service now handles low level K8s API calls across both K8s deployment
an service API objects
* Runtime has a task queue that serves for queueing runtime action
requests
* General refactoring

* No need for Lock in k8s service

* Added kubernetes runtime env var to default deployment

* Enable running different versions of the same service

* Can't delete services through labels

* Proto cruft. Added runtime.CreateOptions implementation in proto

* Removed proxy service from default env variables

* Make service name mandatory param to Get method

* Get Delete changes from https://github.com/micro/go-micro/pull/945

* Replaced template files with global variables

* Validate service names before sending K8s API request

* Refactored Kubernetes API client. Fixed typos.

* Added client.Resource to make API resources more explicit in code
 2019-11-15 13:41:40 +00:00
Asim Aslam
383658edf2
Fix a runtime deadlock as well as fixing some graceful exiting issues (#945) 2019-11-14 14:26:21 +00:00
Milos Gajdos
1ffa289d39 Make build timestamp parsing errors clearer (#929) 2019-11-08 15:57:07 +00:00
Milos Gajdos
6f7702a093 [WIP] K8s update and runtime package changes (#895) 
* First commit: outline of K8s runtime package

* Added poller. Added auto-updater into default runtime

* Added build and updated Poller interface

* Added comments and NewRuntime that accepts Options

* DefaultPoller; Runtime options

* First commit to add Kubernetes cruft

* Add comments

* Add micro- prefix to K8s runtime service names

* Get rid of import cycles. Move K8s runtime into main runtime package

* Major refactoring: Poller replaced by Notifier

POller has been replaced by Notifier which returns a channel of events
that can be consumed and acted upon.

* Added runtime configuration options

* K8s runtime is now Kubernetes runtime in dedicated pkg. Naming kung-fu.

* Fix typo in command.

* Fixed typo

* Dont Delete service when runtime stops.

runtime.Stop stops services; no need to double-stop

* Track runtime services

* Parse Unix timestamps properly

* Added deployments into K8s client. Debug logging
 2019-11-02 13:25:10 +00:00
Asim Aslam
e9dfccc616 Fix panic caused when ctrl+c a non started service 2019-11-01 15:08:01 +00:00
Asim Aslam
967d7ecda7 fix runtime panic 2019-10-31 22:30:21 +00:00
Asim Aslam
dab0f3223f Add Update/List endpoints to runtime 2019-10-29 12:29:21 +00:00
Asim Aslam
96e79c4498 Add runtime output 2019-09-24 19:00:11 +01:00
Asim Aslam
1b08036a0b add create options 2019-09-24 18:32:35 +01:00
Asim Aslam
c52651c4d0 Move runtime.Start to be non blocking 2019-09-24 18:05:51 +01:00
Asim Aslam
364c5a4861 Immediately start services 2019-09-14 08:07:36 -07:00
Asim Aslam
0cdfc7b9ea add create/delete/start/stop to runtime 2019-09-13 21:58:03 -07:00
Asim Aslam
0fc4c180ee update runtime to function 2019-09-13 21:33:14 -07:00