Changes

Summary

1. Connection type 'Hono' introduced (details)
2. HonoConfig introduced to provide properties for the new Hono-connection type (details)
3. DefaultHonoConfig and conf files update (details)
4. Config values added (details)
5. Redundant file removed (details)
6. HonoCredentials taken from static configuration (details)
7. Config refactored (details)
8. Config refactored (details)
9. Connection "enrichment" (details)
10. CR-11462 Add HonoValidator impl and Junit tests (details)
11. Connection "enrichment" (details)
12. Fixed HonoValidator merge issues (details)
13. Hono-connection enrichment fixed (details)
14. ConfigValues renamed to HonoConfigValue, minor fixes (details)
15. Review issues fixes, unit tests fixed (details)
16. Review issues fixes, unit tests fixed (details)
17. DefaultHonoConfig class moved from api to service, URI init fixed (details)
18. Minor refactoring of ConfigWithFallback. (details)
19. Streamline behaviour of DefaultScopedConfig in case of an unknown enum value. (details)
20. Refactored HonoConfig. (details)
21. Connection enrichment refactored, HonoConfig cleaned up. (details)
22. Refactored `HonoAddressAlias` and added unit tests. (details)
23. Refactored `HonoValidator` and adjusted unit tests. (details)
24. Unit tests created (details)
25. Fixed compilation errors of `HonoConnectionFactoryTest`. (details)
26. Cleaned up `HonoConfig`. (details)
27. Refactored `HonoConnectionFactory`. (details)
28. Reordered import. (details)
29. Further simplified `HonoAddressAlias`. (details)
30. Fixed unit test. (details)
31. Moved back method for getting `HonoAddressAlias` by alias value to the enum itself. (details)
32. Made `HonoConnectionFactory` a `DittoExtensionPoint`. (details)
33. initial commit of "Policy imports" functionality after Ditto 3.0 refactoring - preserved via former PoCs and contributions on that topic (details)
34. newInstance() method added to UserPasswordCredentials class (details)
35. replyTargetEnabled bug in ImmutableSource fixed (details)
36. Custom `headerMappings` and custom `groupId` in `specificConfig` allowed. (details)
37. groupId handling changed (details)
38. Replace importable flag of a policy entry with ImportableType enum to allow more differentiated options (implicit, explicit, never). Simplify included/excluded notation from policy imports and expect only a list of (included) policy entries. Adapt PolicyImporter accordingly. (details)
39. Some polishing, method names, comments, etc. Added more tests to PolicyImporterTest. (details)
40. fix test by adding some more subjects to increase size of policy entry (the limits changed a bit after recent modifications) (details)
41. use default value for importable type defined in ImmutablePolicyEntry (details)
42. Resolve imports when creating the PolicyEnforcer (details)
43. rename Policy.getImports() to Policy.getPolicyImports to be consistent with other methods (details)
44. fix check for existence of policy import in DeletePolicyImportStrategy (details)
45. fix compile error (details)
46. fix failing unittests (details)
47. add missing DeletePolicyImportStrategyTest (details)
48. invalidate policy enforcer cache of policies that import a changed policy (details)
49. Ensure that a policy tag is published when the imports of a policy change (details)
50. change Policy.getPolicyImports() to not return an optional of PolicyImports but instead default to an empty PolicyImports instance if no imports are defined and always return a non-null instance (details)
51. adapt to previous changes of policy model (details)
52. Fix resolving of imported policies in PolicyEnforcerActor (details)
53. Make PolicyCacheLoader an Extension and therefore a singleton (details)
54. Stabilized unittest (details)
55. Fix failing unittest which didn't expect empty imports by default (details)
56. remove wrong @Nullable annotation (details)
57. implement pre-enforcer to enforce read access on imported policies (details)
58. Use fully resolved policy (including imports) when building write models (details)
59. Invalidate search index for thing when a policy imported by the thing policy changes (details)
60. load PolicyEnforcerProvider using an extension (details)
61. add basic logging to PolicyImportsPreEnforcer (details)
62. ignore order of referenced policy tags (details)
63. enforce read access on all policy entries that are imported implicitly (details)
64. small fixes and improvements of error handling related to policy imports (details)
65. Fixed multiple issues regarding imported policies in the search index (details)
66. add policy imports documentation to openapi (details)
67. make policy import resolving asynchronous (details)
68. optimize policy enforcer cache invalidation (details)
69. optimize map building (details)
70. Consider change of importable type as semantical change (details)
71. remove unused code in LabelInvalidException (details)
72. throw PolicyImportInvalidException if policy import references own policy, consolidate/simplify policy size validation in policy strategies (details)
73. fix failing tests (details)
74. Hono-credentials added to connectivity-extension.conf (details)
75. retrieveHonoConnection piggyback command introduced. (details)
76. Automatic reconnect of 'hono' connection after credentials are changed. (details)
77. Copyright headers fixes (details)
78. check also for self reference in policy modify commands (details)
79. improve logging (details)
80. Javadoc improved. (details)
81. some fixes after merge (details)
82. Integrate Hono connection in ditto ConnectionRoute (details)
83. validate policy on modification and check whether the policy or an imported entry allows WRITE on policy root resource (details)
84. do not fallback to ImportableType implicit if given type is not valid but return an error instead (default is still implicit, if value is not provided) (details)
85. Revert "validate policy on modification and check whether the policy or an imported entry allows WRITE on policy root resource" (details)
86. Hono-connection resolving added for TestConnection (dry-run) (details)
87. HubParamsModified renamed to HubInstanceInfoModified, few logs added (details)
88. fix timing issues for LiveSignalEnforcementTest (details)
89. fix compilation after merging master (details)
90. CR-11683 Bug fixed in handling of 'Event' (details)
91. document policy imports and extend ditto protocol specification (details)
92. added limit for maximum number of policies to be imported (details)
93. Review issues fixes. (details)
94. Automatic reconnect fixed to filter hono-connections only (details)
95. Auto-reconnect review issues fixed. (details)
96. Revert ConnectionRoute to origin/master and change REST API documentation (details)
97. Reverted ConnectionRoute to origin/master (details)
98. Javadoc fixed (details)
99. More review issues fixed. (details)
100. Changed ConnectionId.generateRandom() (details)
101. Introduce dedicated implementation of HonoConnection (details)
102. fix tests temporarily (details)
103. fix hashCode of DefaultLimitsConfig (details)
104. fixed typos and review comments (details)
105. Refactored things.js and split into smaller files (details)
106. Fixed HonoConnection implementation and added HonoConnection test (details)
107. Add SSE support to Explorer UI (details)
108. adding some system tests for policy imports (details)
109. Introduce AbstractConnection and AbstractConnectionBuilder (details)
110. Hono connection default config kafka parameters changed (details)
111. Unit test fixed (details)
112. Removed empty rows, checked for hono conn. type in getConnectionTypeOrThrow (details)
113. Documentation updated regarding Hono connection (details)
114. Fixed copyright headers (details)
115. Fixed review issues in connectivity-protocol-bindings-hono.md (details)
116. fix for putPolicyWithTooManyImports method (details)
117. Copyright headers (details)
118. fixed @since TODOs (details)
119. fix for PolicySupervisorActorTest (details)
120. fix for PolicySupervisorActorTest (details)
121. fix missing OpenAPI "policy import" references and re-generated ditto-api-2.yml (details)
122. fixed sandbox "Content-Security-Policy" for Ditto UI (details)
123. disable caching for sandbox (details)
124. updated Connectivity_Metrics.json Grafana dashboard to include per connection-id filtering for top row (details)
125. updated Connectivity_Metrics.json to also filter id on throttled connections (details)
126. fix json pointers config when read from env (details)
127. fix alerting in Connectivity_Metrics.json (details)
128. fix license header year (details)
129. added missing label for throttled connections (details)
130. adjusted 3.1.0 release date in docs (details)
131. fixed RELEASE.md (details)
132. update binary compatibility version to 3.1.0 (details)
133. Update SECURITY.md (details)
134. SSE for explorer UI next step (details)
135. adjust since tags in javadoc to Ditto version 3.2.0 (details)
136. fixed openAPI error (details)
137. fixed broken links due to missing "delete policy import" resource (details)
138. SSE for explorer UI: resolved error from merge (details)
139. Revert "Fix incorrect envelope in ClientSupervisor." (details)
140. Revert "Add serializer for ClientActorPropsArgs." (details)
141. Revert "Replace consistent hashable envelope by a dedicated binary message envelope for communication between the connection persistence actor and its client actors." (details)
142. Revert "Move client actor shutdown to shard region shutdown phase to prevent restarts during coordinated shutdown." (details)
143. Revert "Add hand-off messages to connection and client shard regions." (details)
144. Revert "Fix close-connection behavior of ClientSupervisor; fix ConnectionPersistenceActorTest." (details)
145. Revert "Fix client shard region name; reintroduce CLOSE_CONNECTION stage to restore connection connection announcements." (details)
146. Revert "Remove headers as a part of client actor props to prevent accidental restarts." (details)
147. Revert "Move client actors to their own shard region." (details)
148. Revert "ClientSupervisor: Retrieve connection status on startup to deal with shard rebalancing." (details)
149. Revert "Fix metrics "connection_client" and "connecting_client" underreporting due to multiple client actors of a connection starting on the same instance." (details)
150. added release notes for Ditto 3.1.1 (details)
151. Enable "History API" support: (details)
152. switch to MongoDB 5 for deployment descriptors by default (details)
153. Explorer UI - SSE and optimistic locking (details)
154. Explorer UI - Apply new edit style to environments (details)
155. Explorer UI - Add new edit style to connections (details)
156. improved sandbox nginx security headers (details)
157. add additional status-secured configuration to enable disabling securing the status endpoint while still securing the devops endpoint (details)
158. external message to mqtt publish transform should not fail on blank header values (details)
159. Explorere UI - SSE support (details)
160. Explorer UI - SSE support (details)
161. Explorer UI - SSE support (details)
162. Explorer UI - SSE bugfix (details)
163. added documentation about enhancing the JS payload mapping with custom libraries (details)
164. remove not supported mongo features (details)
165. UI - SSE support: (details)
166. extracts rawUserInfo to prevent unwanted url decoding (details)
167. commented failing tests out (details)
168. Update SECURITY.md (details)
169. UI - SSE Support: (details)
170. UI - SSE support - testing and bugfixing (details)
171. Connections API doc fixes Ditto (details)
172. rewrite MongoReadJournal aggregation for gathering "newest" active snapshots (details)
173. re-enabled formerly disabled tests (details)
174. added config parameter for "documentDB-compatibility-mode" (details)
175. conditionally create "wildcard index" in search only if not running in "documentDbCompatibilityMode" (details)
176. fixed Grafana dashboard datasource configurations (details)
177. added example prometheus.yml config for a Ditto deployment (details)
178. added 30 minutes overview of Eclipse Ditto slides (details)
179. improved documentation on token handling with e.g. "oauth2-proxy" (details)
180. enhanced Connections with their "_revision", "_created" and "_modified" information (details)
181. fixed that a missing (deleted) referenced policy of a policy import caused logging ERRORs in the BackgroundSyncStream (details)
182. stabilized DittoProtocolSubImpl when unresolved placeholders were contained in acknowledgement labels (details)
183. updated github repository locations to new "eclipse-ditto" org (details)
184. added running instructions for running Ditto agsinst Amazon DocumentDB (details)
185. added streaming protocol usage example to history documentation (details)
186. increased defaults for configured history-retention-duration (details)
187. provide release notes for Ditto bugfix release 3.1.2 (details)
188. updated sidebar to inlcude release 3.1.2 (details)
189. updated default ditto.protocol.blocklist to exclude headers "accept-encoding" and "x-forwarded-scheme" (details)
190. Hono connection address suffix added - hono tenant id (details)
191. Added case insensitive search for things-search (details)
192. correction & update the year in the copyright headers of the added files to 2023 (details)
193. correction and refactoring in ilike (details)
194. correction & refactoring in LikeHelperTest class & removed copy&paste error (details)
195. stabilize MQTT unsubscribing (details)
196. added agreed on "additional OSS contributing rules" for Eclipse Ditto to existing CONTRIBUTING.md (details)
197. Fixed from review issues in documentation. (details)
198. re-generated openapi docs (details)
199. improve resiliency of connection id retrieval from journal by excluding empty events (details)
200. added "ilike" to thingssearch-model (details)
201. ignore very unstable unit test (details)
202. removed access token from star history chart (details)
203. Explorer UI - autocomplete for search (details)
204. update Jekyll version in Gemfile dependencies to get local build/serve working (details)
205. Create of thing's policy is atomic with creation the of thing itself (details)
206. Explorer UI - change favorite spelling (details)
207. UI - removed old dropdown for searchfilters (details)
208. fix href in docs (details)
209. [#1592] provide "Bearer" authentication for devops resources controlled via UI (details)
210. [#1592] switched grouping of different auth* methods based on "main / devops" auth (details)
211. Added unit tests and fixed things pointed out in the code review. (details)
212. prepare Ditto 3.2.0 release (details)
213. post Ditto 3.2.0 release: update binary-compatibility-check to version 3.2.0 (details)
214. post Ditto 3.2.0 release: update SECURITY.md (details)
215. [#1592] provide "Bearer" authentication for devops resources controlled via UI (details)
216. [#1592] switched grouping of different auth* methods based on "main / devops" auth (details)
217. prepare Ditto 3.2.0 release (details)
218. post Ditto 3.2.0 release: update binary-compatibility-check to version 3.2.0 (details)
219. post Ditto 3.2.0 release: update SECURITY.md (details)
220. adding some documentation to available configuration (details)
221. fix reading configured WoT TD "json template" from system property (details)
222. configure OpenAPI doc to also contain configurable "Bearer" security for /connections resource (details)
223. Fixed filtering desired properties signals. #1599 (details)
224. Moved filtering test to more suitable place (details)
225. remove mentioning Vorto from "Hello World" (details)
226. don't use WARN log level when no policy is rolled back (details)
227. don't use WARN log level when "Target actor exception received" (details)
228. enforcer actor ack time out handled in atomic thing create context (#1598) (details)
229. fixed OverflowStrategy in SupervisedStream to backpressure instead of failing (details)
230. UI - New Operations tab (#1600) (details)
231. fix in UI that "bearerDevOps" token is stored to local storage (details)
232. provide release notes for Ditto 3.2.1 (details)
233. #1593 support removing existing fields from a JSON object in a merge patch using a regular expression (details)
234. #1593 added special "merge command" enforcement for patches including a regex: in that case, unrestricted WRITE access on the contained JSON object is required (details)
235. #1614 enabled creating a thing for a "MergeThing" when it does not yet exist (details)
236. #1619 adjusted monitor to use in OutboundMappingProcessorActor#messageDiscarded (details)
237. fixed OverflowStrategy in SupervisedStream to backpressure instead of failing (details)
238. UI - New Operations tab (#1600) (details)
239. fix in UI that "bearerDevOps" token is stored to local storage (details)
240. provide release notes for Ditto 3.2.1 (details)
241. #1593 support removing existing fields from a JSON object in a merge patch using a regular expression (details)
242. #1593 added special "merge command" enforcement for patches including a regex: in that case, unrestricted WRITE access on the contained JSON object is required (details)
243. uniform paths using " char instead of ' (details)
244. fix openapi error (details)
245. #1614 provided documentation for creating a thing with "merge/patch command" (details)
246. add devops swagger to openapi project (details)
247. fix copyright header with file creation year '2023' (details)
248. move all api in one file. Modify servers to point root path /. Modify old api entry point in /api/2. Add new devops api with entry point /devops and devops credentials. (details)
249. UI - Build UI with esbuild (details)
250. group Devops APIs iin unique tag (details)
251. #1619 adjusted monitor to use in OutboundMappingProcessorActor#messageDiscarded (details)
252. UI - build with esbuild (details)
253. UI with esbuild: added missing bootstrap imports (details)
254. UI with esbuild (details)
255. Provide Helm chart in Ditto repository (details)
256. added initial GitHub actions CI files for linting/installing Ditto helm chart on Helm chart changes (details)
257. moved Helm chart into directory "ditto" (details)
258. fixed Helm linting errors (details)
259. fixed kubeval chart dir (details)
260. added ci customization for lower resources (details)
261. configured ci customization for lower resources correctly (details)
262. reduce CPU requests for testing chart (details)
263. added GH action for publishing Ditto Helm chart to Docker Hub (details)
264. added README.md for new Ditto Helm chart specifying configuration options (details)
265. added build steps for UI for: (details)
266. fixed README typos (details)
267. add npm install for gh-pages build (details)
268. add npm install for all other GH builds (details)
269. #1524 added "if-equal" header to define whether to "skip" and update of an equal value (details)
270. #1524 provided unit tests for policies and things conditional "if-equal" header (details)
271. improve DittoProtocol `MessagePath` to be aware of message subject (details)
272. #1524 provided documentation for new `if-equal` header (details)
273. #1524 renamed IfEqualOption enum (details)
274. #1524 addressed review comments (details)
275. #1644 support query params in the style where not comma separation is used, but duplicated keys (details)
276. fix helm chart release GH action (details)
277. fix helm chart release GH action, added checkout (details)
278. fix errors in connection JSON schema (details)
279. fix helm chart release GH action, completely specified helm commands by our own (details)
280. Update README.md (details)
281. exhange Ditto Helm chart curl version (details)
282. fix that redeliveries for acknowledgable connectivity messages were issued to often (details)
283. fix WoT dispatcher starvation by adding timeouts to fetch models (details)
284. filter out tm:optional in WoT TMs from being created as JSON skeleton elements (details)
285. #1649 remove network policies from Ditto Helm Chart (details)
286. updated dependencies and NOTICE-THIRD-PARTY.md (details)
287. prepare Ditto 3.3.0 release (details)
288. adjusted Eclipse Ditto domain to eclipse.dev/ditto (details)
289. improve AskWithRetry WARN logging (details)
290. #1644 fix filtering out empty field selectors (details)
291. prepare Helm chart for 3.3.0 release (details)
292. run .join() operations in WoT integration always on dedicated dispatcher + configure timeout (details)
293. fix WoT skeleton creation doing blocking operations on Akka dispatcher thread (details)
294. #1663 fix that nginx's worker_processes setting 'auto' causes problems when deploying Helm chart to worker with many CPUs (details)
295. update swagger-ui version and nginx version used in Helm chart (details)
296. address review finding that "catch" block should be replaced with ".exceptionally" instead on CompletionStage (details)
297. also made WoT based queries asynchronous (details)
298. #1669 by default, configure queryReadConcern: "local" for ditto things-search (details)
299. #1670 fix wrong config path for pulling devops and status password from helm values (details)
300. restored old "synchronous path" for mutations and queries (details)
301. got rid of blocking the Akka dispatcher thread completely (details)
302. removed no longer used constant (details)
303. fix handling weak ack for built-in ack labels in StreamingSessionActor (details)
304. fix "policies.imports-limit" configuration which had wrong config key in code and was not applied (details)
305. Support for ingress controller (details)
306. Creation of ingress-nginx namespace (details)
307. Bump Chart version (details)
308. controller section under ingress (details)
309. Limit number of worker processes for ingress nginx healh-check (details)
310. Properly setting ingress class in ingress controller (details)
311. prepare Ditto 3.3.1 bugfix release (details)
312. update chart version and appVersion to 3.3.1 (details)
313. prepare Ditto 3.3.2 (details)
314. fix that ImmutablePolicyImports.getPolicyImport with arbitrary CharSequence did not work (details)
315. fix JsonSchema for policy "announcements" (details)
316. fix(helm): Allow inter cluster communication (details)
317. chores(helm): Bump chart version (details)
318. fix(gha): Avoid running cron on forks (details)
319. fix non-correct WARN log about potentially failing connections status (details)
320. fix(gha): Hardcode repo name into action (details)
321. fix MergeThing command being used for creating new things did not respect "inlinePolicy" (details)
322. prepare release notes for Ditto 3.3.3 (details)
323. update to Ditto 3.3.3 in helm chart (details)
324. fix that CreationRestrictionPreEnforcer did not work (details)
325. Helm chart: add support for entity creation via Helm configuration (details)
326. adjusted Eclipse Ditto domain to eclipse.dev/ditto (details)
327. prepare Ditto 3.3.4 release notes (details)
328. prepare Helm chart for 3.3.4 release (details)
329. UI - migrate to typescript (details)
330. bump Akka version to 2.6.21 (details)
331. UI - add typescript compiler to build step (details)
332. #1692 fix filtering of live message with empty resolved `extraFields` (details)
333. #1691 fixed persisting inline "_policy" in ThingMerged events (details)
334. #1690 use correct HTTP status code for "if-equal": skip on equality (details)
335. adjusted method name of exception builder (details)
336. fix that in Helm config `jwtOnly=false` will enabled pre-authentication in Ditto (details)
337. added github action for building UI on PRs (details)
338. Provide Ditto 3.3.5 release notes (details)
339. update Ditto version in Helm chart to 3.3.5 (details)
340. Support for basic nginx-ingress authentication (details)
341. increase log level from info to warn for "emptied out" search index update (details)
342. updated sitemap url (details)
343. Bump Chart version (details)
344. Remove hardcoded release name from the values.yaml file (details)
345. added post method for search and count (details)
346. Use Ditto-UI from docker Hub in default docker-compose.yml (details)
347. fix providing Ditto Adaptable information in the "_context" of an SSE event (details)
348. Correct documentation of RawMessage payload mapper headers (details)
349. Remove accidentally duplicated section (details)
350. fix using "/cloudevents" endpoint for other entities than things (details)
351. provide Ditto 3.3.6 release notes (details)
352. bump Ditto Helm chart appVersion to 3.3.6 (details)
353. fix release notes link 3.3.6 (details)
354. switch dependencies and imports to Pekko (details)
355. update documentation links (details)
356. move repositories from bom to root pom (details)
357. fix some wrong package names (details)
358. fix ddata tests (details)
359. renamed somma Akka leftovers in javadocs (details)
360. renamed somma AKKA_ in env variables to PEKKO_ (details)
361. ConnectionPerssistenceActor PLUGIN_ID to pekko (details)
362. use ported pekko-persistence-inmemory (details)
363. fixed some other akka leftovers (details)
364. fix unit tests (details)
365. dependency fix (details)
366. pekko management to v 1.0.0 (details)
367. pekko-persistence-mongodb to v 1.0 (details)
368. alpakka to pekko-connectors migration (details)
369. update NOTICE-THIRD-PARTY.md (details)
370. override pekko-serialization-jackson (details)
371. try to fix pekko-serialization-jackson bad transitive version (details)
372. update deployment/* files to pekko (details)
373. update legal dependencies files (details)
374. some more akka leftovers in deployment (details)
375. switch pekko-persistence-inmemory to sonatype repo (details)
376. set management port to Pekko's new default 7626 (details)
377. remove snapshot repos and fix inmemory plugin version (details)
378. sync mongo java driver version with pekko-persistence-mongodb (details)
379. pekko-persistence-mongodb version to 1.0.1, metadata-index name configs (details)
380. update documentation with migration steps (details)
381. remove unneeded line from config (details)
382. add topology spread constraints so ditto services spread equally among cluster nodes (details)
383. extract to values.yaml file hard-coded nginx-ingress configuration values (details)
384. Bump Chart version (details)
385. enable configuration of size "limits" in Helm chart (details)
386. feat(helm): allow priorityClassNames to be configured (details)
387. openApi documentation (details)
388. #1731 use tpl function for otelExporterOtlpEndpoint value (details)
389. fix wrong exception message when policy could not be implicitly created when creating thing (details)
390. Correct wording about need for URL-encoding of encryption key (details)
391. update used GitHub actions versions; k8s version matrix for Helm (details)
392. move migration steps to a release_notes file (details)
393. update changelog for 3.4.0 release (details)
394. Remove hint about changing inbox to outbox (details)
395. Allow spaces inside placeholder in target issued acknowledgement label (details)
396. Optimize docker files (details)
397. #1727 add new "thing-json" placeholder to be used in connections (details)
398. ditto docs (details)
399. #1706 fix review findings: (details)
400. fixed wrong use of HashMap vs. LinkedHashMap in policy model (details)
401. provide Ditto 3.3.7 release notes (details)
402. #1727 added unit test, using "thing-json:" placeholder in HTTP path (details)
403. prepare Ditto 3.3.7 Helm chart (details)
404. #1727 added new functions to the functions library: (details)
405. #1727 provided documentation of new "thing-json" placeholder + added functions (details)
406. #1727 fix test (details)
407. #1730 fix test imports after merge of Pekko migration (details)
408. update maven plugins to latest versions (details)
409. #1739 provide the traceparent header as MDC value in logs (details)
410. add IntLevelJsonProvider as logstash/logback provider, adding the log level as "intLevel" (details)
411. #1739 log 2 separate MDC fields: "traceparent-trace-id" and "traceparent-span-id" (details)
412. #1739 removed IntLevelJsonProvider from default logback files in Helm chart (details)
413. #1739 undid chart changes (details)
414. downgrade to Scala 2.13.10 due to unit test errors in ThingsSseRouteBuilderTest (details)
415. update to Scala 2.13.12 again and fix root cause, using `CompletableFuture.completedStage` instead of `CompletableFuture.completedFuture` (details)

Connection type 'Hono' introduced

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

HonoConfig introduced to provide properties for the new Hono-connection type

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

DefaultHonoConfig and conf files update

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Config values added

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Redundant file removed

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

HonoCredentials taken from static configuration

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Config refactored

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Config refactored

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Connection "enrichment"

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

CR-11462 Add HonoValidator impl and Junit tests

Connection "enrichment"

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Fixed HonoValidator merge issues

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Hono-connection enrichment fixed

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

ConfigValues renamed to HonoConfigValue, minor fixes

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Review issues fixes, unit tests fixed

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Review issues fixes, unit tests fixed

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

DefaultHonoConfig class moved from api to service, URI init fixed

Minor refactoring of ConfigWithFallback.
* Extracted method for getting a JsonObject as a Map to improve readability.
* Also use new features of Java 17 to improve readability.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Streamline behaviour of DefaultScopedConfig in case of an unknown enum value.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Refactored HonoConfig.
* Moved interface from connectivity API to connectivity service to limit its scope.
* Moved utility method for getting URI from HonoConfig to implementing class because it is the only place where it is required now.
* Changed getter for bootstrap server URIs to actually return a set of URIs instead of a comma separated string.
* Renamed getter for credentials to state which type of credentials it returns in case there would be other credential types in future.
* Let DefaultHonoConfig base on ScopedConfig to get DittoConfigErrors in case of configuration errors.
* Added unit tests for DefaultHonoConfig.
* Refined some Javadoc comments.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Connection enrichment refactored, HonoConfig cleaned up.

Connection enrichment extracted in a new class DefaultHonoConnectionFactory
HonoConfig cleaned up from the method getTenantId() and the parameter of getCredentials()
HonoConfig simplified - extension mechanism removed.

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Refactored `HonoAddressAlias` and added unit tests.
* Renamed method `getName` to `getAliasValue` to distinct it more clearly from an enum's inherent `name` method.
* Converted methods for resolving addresses from static methods to instance methods. This makes them less error-prone because the alias value does not have to be provided. Furthermore, got rid of the boolean parameter in favour of a more expressive method name.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Refactored `HonoValidator` and adjusted unit tests.
* Applied clean code principles to `HonoValidator` to improve its readability.
* Made existing unit tests more comprehensive.
* Added some unit test cases.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Unit tests created

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Fixed compilation errors of `HonoConnectionFactoryTest`.
`HonoAddressAlias` was refactored beforehand which caused the compilation errors.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Cleaned up `HonoConfig`.

* Removed unused method `getUri`.
* Do not extend `Extension` because it really does not.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Refactored `HonoConnectionFactory`.

* Made the factory more abstract by bringing in more aspects of the template method pattern.
* Moved dependency to `HonoConfig` and some implementation to default implementation.
* Concept of tenant ID is unknown to Ditto, thus removed it.
* Moved methods for resolving addresses from `HonoAddressAlias` to `HonoConnectionFactory`.
* Extended exception handling of `ConnectionPersistenceActor#startAndAskClientActors` to catch failures related to `HonoConnectionFactory`.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Reordered import.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Further simplified `HonoAddressAlias`.

* Removed method `aliasValues` from `HonoAddressAlias` as it was only used in tests.
* Removed method `forAliasValue` from `HonoAddressAlias` because it was only used in `HonoConnectionFactory`.
* Adjusted `HonoAddressAliasTest` accordingly.
* Added mapping from Hono address alias values to `HonoAddress` to `HonoConnectionFactory`.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Fixed unit test.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Moved back method for getting `HonoAddressAlias` by alias value to the enum itself.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

Made `HonoConnectionFactory` a `DittoExtensionPoint`.

Signed-off-by: Juergen Fickel <juergen.fickel@bosch.io>

initial commit of "Policy imports" functionality after Ditto 3.0 refactoring - preserved via former PoCs and contributions on that topic

Co-authored-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>
Co-authored-by: Dirk Van Haerenborgh <dirk.vanhaerenborgh@aloxy.io>
Signed-off-by: Thomas Jaeckle <thomas.jaeckle@bosch.io>

newInstance() method added to UserPasswordCredentials class

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

replyTargetEnabled bug in ImmutableSource fixed

Custom `headerMappings` and custom `groupId` in `specificConfig` allowed.
Messaging credentials embedded in URI.
`originalAddress` resolved too.

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

groupId handling changed

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Replace importable flag of a policy entry with ImportableType enum to allow more differentiated options (implicit, explicit, never). Simplify included/excluded notation from policy imports and expect only a list of (included) policy entries. Adapt PolicyImporter accordingly.

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Some polishing, method names, comments, etc. Added more tests to PolicyImporterTest.

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fix test by adding some more subjects to increase size of policy entry (the limits changed a bit after recent modifications)

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

use default value for importable type defined in ImmutablePolicyEntry

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Resolve imports when creating the PolicyEnforcer

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

rename Policy.getImports() to Policy.getPolicyImports to be consistent with other methods

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fix check for existence of policy import in DeletePolicyImportStrategy

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fix compile error

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fix failing unittests

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

add missing DeletePolicyImportStrategyTest

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>
Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

invalidate policy enforcer cache of policies that import a changed policy

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

Ensure that a policy tag is published when the imports of a policy change

* This change indicates a semantic change of the policy and should lead
  to cache invalidation

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

change Policy.getPolicyImports() to not return an optional of PolicyImports but instead default to an empty PolicyImports instance if no imports are defined and always return a non-null instance

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

adapt to previous changes of policy model

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Fix resolving of imported policies in PolicyEnforcerActor

* TODO: think about making PolicyEnforcerProvider and PolicyCacheLoader
  an akka extension in order to make it a singleton

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

Make PolicyCacheLoader an Extension and therefore a singleton

* Only exception is the search, where the cache loader is instantiated
  differently

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

Stabilized unittest

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

Fix failing unittest which didn't expect empty imports by default

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

remove wrong @Nullable annotation

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

implement pre-enforcer to enforce read access on imported policies

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Use fully resolved policy (including imports) when building write models
for the search index

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

Invalidate search index for thing when a policy imported by the thing policy changes

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

load PolicyEnforcerProvider using an extension

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

add basic logging to PolicyImportsPreEnforcer

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

ignore order of referenced policy tags

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

enforce read access on all policy entries that are imported implicitly

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

small fixes and improvements of error handling related to policy imports

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Fixed multiple issues regarding imported policies in the search index

* The query in MongoThingsSearchUpdaterPersistence wasn't correct because
  the "id" field was extracted from the JSON pointer which appended a leading
  slash
* We need to remember deleted but still imported policies otherwise the
  search index is not updated when the imported policy is recreated
* Imported policies need to be taken into account when checking if a
  write model is outdated
* The Metadata built by the ThingUpdater needs to preserve the thingPolicy
  aswell as the referenced policy tags

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

add policy imports documentation to openapi

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

make policy import resolving asynchronous

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

optimize policy enforcer cache invalidation

* Maintain a map from imported policies to their importing policies which allows
  to avoid iterating over the full cache content when invalidating the policy cache

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

optimize map building

* Map is now only modified when the policy is loaded from the cache loader
  instead of every access of the cache
* Also fix issue that the map was never "cleaned up" which is now happening
  on invalidation

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

Consider change of importable type as semantical change

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

remove unused code in LabelInvalidException

Signed-off-by: Yannic Buergmann <yannic.buergmann@bosch.io>

throw PolicyImportInvalidException if policy import references own policy, consolidate/simplify policy size validation in policy strategies

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fix failing tests

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Hono-credentials added to connectivity-extension.conf

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

retrieveHonoConnection piggyback command introduced.

A new piggyback command 'retrieveHonoConnection' is implemented which retrieves a 'real' connection of type 'Hono' (with already resolved address aliases, added header mappings , specificConfig etc.)

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Automatic reconnect of 'hono' connection after credentials are changed.

On Hub-credentials changes, ConnectionSupervisorActor gets notified by SolutionModifiedActor in order to restart the potentially active 'Hono'-connection with the new parameters.

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Copyright headers fixes

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

check also for self reference in policy modify commands

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

improve logging

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Javadoc improved.

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

some fixes after merge

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

Integrate Hono connection in ditto ConnectionRoute

validate policy on modification and check whether the policy or an imported entry allows WRITE on policy root resource

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

do not fallback to ImportableType implicit if given type is not valid but return an error instead (default is still implicit, if value is not provided)

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

Revert "validate policy on modification and check whether the policy or an imported entry allows WRITE on policy root resource"

This reverts commit 92f7ac587379516ad69c5998bbc46880cedbc667.

Hono-connection resolving added for TestConnection (dry-run)

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

HubParamsModified renamed to HubInstanceInfoModified, few logs added

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

fix timing issues for LiveSignalEnforcementTest

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

fix compilation after merging master

Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

CR-11683 Bug fixed in handling of 'Event'

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>

document policy imports and extend ditto protocol specification

Co-authored-by: Kalin Kostashki <kalin.kostashki@bosch.io>
Signed-off-by: Dominik Guggemos <dominik.guggemos@bosch.io>

added limit for maximum number of policies to be imported

 - created a custom PolicyImportsTooLargeException in order to facilitate sending of correct error response to user
 - small typos and fixes as needed
 - made the policy imports limit configurable in ditto-limits.conf

Signed-off-by: Kalin Kostashki <kalin.kostashki@bosch.io>

Review issues fixes.

Signed-off-by: Andrey Balarev <andrey.balarev@bosch.io>