Releases: apache/inlong
Releases · apache/inlong
2.3.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-11995 | [Feature][Agent] The Agent supports parallel creation of Sender connections to the DataProxy, improving creation efficiency |
| INLONG-12003 | [Feature][Agent] Added the agent_ext.properties configuration file loading to prevent personalized configurations from being lost when the agent.properties configuration file is overwritten during upgrades |
Dashboard
| ISSUE | Summary |
|---|---|
| INLONG-11972 | [Bug][Dashboard] Occasional audit queries based on group queries have query conditions including streamid |
| INLONG-11897 | [Bug][Dashboard] Click on the audit page to query multiple calls to the interface |
| INLONG-11894 | [Feature][Dashboard] Added group and stream switching on the audit page |
Manager
| ISSUE | Summary |
|---|---|
| INLONG-11997 | [Feature][Manager] Add comprehensive audit alert rule management API |
| INLONG-11984 | [Bug][Manager] Hive table creation statement error |
| INLONG-11969 | [Bug][Manager] org.apache.flink.client.program.ProgramInvocationException |
| INLONG-11891 | [Improve][Manager]Support querying topic audit information |
| INLONG-11881 | [Feature][Manager] Sink source field supports configuring the fuction function |
| INLONG-11879 | [Improve][Manager] Support parsing transform configuration as transform SQL |
| INLONG-11877 | [Improve][Manager] Support verifying transform SQL |
| INLONG-11875 | [Bug][Manager] InLong standalone mode deployment failed |
SDK
| ISSUE | Summary |
|---|---|
| INLONG-12019 | [Feature][SDK] Transformation supports a caching mechanism for processing identical function parameters within the same SQL statement to reduce redundant computations |
| INLONG-12014 | [Improve][SDK] Add C++ Dataproxy SDK compile Dockerfile |
| INLONG-12012 | [Improve][SDK] Change the Python Dataproxy SDK user-defined installation path configuration method |
| INLONG-12010 | [Bug][SDK] Python DataProxy SDK reported data is truncated |
| INLONG-11974 | [Feature][Sort] Upgrade pulsar sdk version to 4.0.3 |
| INLONG-11976 | [Improve][SDK] DataProxy Go SDK support detailed error information in server responses |
| INLONG-11961 | [Feature][SDK] Transform supports array index access, the WHERE clause supports the LIKE operator, and the str_to_json function converts KV-format data into JSON format |
| INLONG-11954 | [Bug][SDK] Potential data race in Golang SDK |
| INLONG-11952 | [Feature][SDK] Transform handles field-level exceptions by nullifying only the affected field while preserving the entire record |
| INLONG-11926 | [Feature][SDK] If SortSDK fails to retrieve GroupId and StreamId from the InLongMsgV0 protocol, it defaults to obtaining them from the unified metadata. |
| INLONG-11907 | [Feature][SDK] Transform support IN operator |
| INLONG-11905 | [Feature][SDK] TransformSDK calls the org.reflections library APIs according to version 0.9.12, not version 0.10.2. |
| INLONG-11887 | [Improve][SDK] Enhance the .so file copy logic of the Python SDK installation script |
| INLONG-11873 | [Feature][SDK] Support parsing field values from extended parameters |
| INLONG-11871 | [Bug] Go programs importing the DataProxy SDK may crash with no way to handle the error |
| INLONG-11869 | [Improve][SDK]Obtain a valid ip during initialization |
| INLONG-11865 | [Improve][SDK]Obtain a valid local IP address |
| INLONG-11863 | [Improve][SDK] Enhance Event Attribute Validation and Decoding Logic in SDK |
| INLONG-11861 | [Bug][CI] Compile dataproxy-sdk fail when there is no .git dictionary in the base path |
Sort
| ISSUE | Summary |
|---|---|
| INLONG-12021 | [Improve][CVE] Elasticsearch Uncontrolled Resource Consumption Vulnerability |
| INLONG-12007 | [Feature][Sort] SortPulsar supports topic concatenation |
| INLONG-11982 | [Bug][Sort] Null Point Exception when changelogAuditKey is not set |
| INLONG-11974 | [Feature][Sort] Upgrade pulsar sdk version to 4.0.3 |
| INLONG-11966 | [Feature][Sort] The deserialization process supports returning the data byte size in one rowdata |
| INLONG-11958 | [Feature][Sort] Allow SortCkafka to filter out data in TransformFunction |
| INLONG-11944 | [Feature][Sort] TransformFunction: parse_url supports parsing URL query strings |
| INLONG-11942 | [Feature][Sort] TransformFunction: url_decode supports specifying character sets |
| INLONG-11943 | [Feature][Sort] TransformFunction: url_encode supports specifying character sets |
| INLONG-11939 | [Feature][Sort] Support that TaskConfig merge issue preventing configuration changes from taking effect |
| INLONG-11937 | [Feature][Sort] Allow SortHttp to filter out data in TransformFunction |
| INLONG-11931 | [Feature][Sort] Optimize Transform's CSV/KV parsing |
| INLONG-11926 | [Feature][SDK] If SortSDK fails to retrieve GroupId and StreamId from the InLongMsgV0 protocol, it defaults to obtaining them from the unified metadata. |
| INLONG-11911 | [Feature][Sort] SortStandalone supports routing PB-format data streams to Kafka and Pulsar |
| INLONG-11909 | [Feature][Sort] Optimize the generation of tube session key |
| INLONG-11902 | [Feature][Sort] Allow SortCls to filter out data in TransformFunction |
| INLONG-11892 | [Feature][Sort] SortStandalone support Negative Acknowledgment mechanism for delivery failures |
| INLONG-11888 | [Feature][Sort] Sort ElasticSearch supports format conversion and data filtering via Key/Value data format |
| INLONG-11885 | [Feature][Sort] Unified Metadata supports delayed and phased decommissioning of metadata configurations. |
| INLONG-11883 | [Feature][Sort] Sort CLS supports format conversion and data filtering via Transform Functions. |
Audit
| ISSUE | Summary |
|---|---|
| INLONG-11999 | [Feature][Audit] Add alert evaluation and periodic audit check task |
| INLONG-12000 | [Feature][Audit] Implement API for obtaining audit data in Audit Tool |
| INLONG-11998 | [Feature][Audit] Implement APIs for Audit Tool to interact with Manager |
| INLONG-11993 | [Improve][Audit] The audit service supports customizing the cache on and off |
| INLONG-11900 | [Improve][Audit] In the case of no data, the Audit OpenAPI defaults to 0 |
TubeMQ
| ISSUE | Summary |
|---|---|
| INLONG-11948 | [Bug][Docker] TubeMQ image build failed |
2.2.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-11815 | [Improve][Agent] Add a unified reporting point for events |
| INLONG-11813 | [Improve][Agent] Add Dataproxy SDK debug log |
| INLONG-11811 | [Improve][Agent] Increase the retention time of offset, default to 7 days |
| INLONG-11778 | [Improve][Agent] Separate the logs of the DataProxy SDK |
| INLONG-11776 | [Improve][Agent] Optimize the mechanism for controlling the number of instances |
| INLONG-11774 | [Improve][Agent] Modify the lifecycle of the DataProxy SDK object |
| INLONG-11762 | [Improve][Agent] Modify the logic for determining the end of the data source |
| INLONG-11760 | [Improve][Agent] Increase the number of global instances control |
| INLONG-11752 | [Improve][Agent] Modify the default collection range of data |
| INLONG-11687 | [Improve][Agent] Optimize task main thread exception handling to prevent exception exits |
| INLONG-11685 | [Improve][Agent] Agent needs to modify the logic of confirming its own IP address |
| INLONG-11681 | [Bug][Agent] Duplicate file collection |
Dashboard
| ISSUE | Summary |
|---|---|
| INLONG-11799 | [Bug][Dashboard] The page will not refresh after the access groupId is switched |
| INLONG-11772 | [Improve][Dashboard] User login verify fail |
Manager
| ISSUE | Summary |
|---|---|
| INLONG-11794 | [Improve][Manager][Sort]Pulsar source supports setting scan.startup.mode to null |
| INLONG-11764 | [Improve][Manager] Support SQL stream source |
| INLONG-11751 | [Bug][Manager] Failed to delete inlong group for groupId |
| INLONG-11746 | [Improve][Manager] When special characters appear in the JDBC URL, sensitive parameter validation can be bypassed |
| INLONG-11731 | [Improve][Manager]Sensitive parameters are bypassed during JDBC verification processing |
| INLONG-11722 | [Improve][Manager] Pulsar source supports Inlong properties field |
SDK
| ISSUE | Summary |
|---|---|
| INLONG-11843 | [Improve][SDK] Validate the input message of Golang SDK |
| INLONG-11830 | [Bug][SDK] NullPointerException while not configure factory permits |
| INLONG-11809 | [Improve][SDK] Adjust the default value of separateEventByLF to false |
| INLONG-11788 | [Improve][SDK] Add processing logic when DataProxyNodeResponse.nodeList field is null |
| INLONG-11787 | [Bug][SDK] Dataproxy Python SDK lacks mutex header file |
| INLONG-11782 | [Improve][SDK]Adjust the Sender initialization codes in example |
| INLONG-11770 | [Improve][Sort][SDK] Fix potential Null Pointer Exception |
| INLONG-11756 | [Improve][SDK] Add NPE check in MsgSender Factory class |
| INLONG-11754 | [Improve][SDK] Add the total number of in-flight requests and total size limits |
| INLONG-11749 | [Improve][SDK] Clean up unused configuration items and functions |
| INLONG-11745 | [Improve][SDK] Clean up HttpProxySender and related implementations |
| INLONG-11743 | [Improve][SDK] Adjustment of metric statistics |
| INLONG-11741 | [Improve][SDK] Clean up the MessageSender interface and related implementation classes |
| INLONG-11738 | [Improve][SDK] Optimize the metric output when MetricDataHolder exits |
| INLONG-11734 | [Improve][SDK] Optimize SDK stop processing flow |
| INLONG-11729 | [Improve][SDK] Optimize TcpClientExample and HttpClientExample codes |
| INLONG-11727 | [Improve][SDK] Replace the Sender used in the agent-plugins module with TcpMsgSender |
| INLONG-11725 | [Improve][SDK] Replace the Sender used in the agent-core module with TcpMsgSender |
| INLONG-11720 | [Improve][SDK] Optimize MsgSenderSingleFactory implementation |
| INLONG-11719 | [Improve][SDK] Replace the Sender object in the InlongSdkDirtySender class with TcpMsgSender |
| INLONG-11717 | [Improve][SDK] Add out-of-bounds check when in getClientByRoundRobin() |
| INLONG-11715 | [Improve][SDK] Optimize metric report content |
| INLONG-11713 | [Improve][SDK] Optimize BaseMsgSenderFactory and TimeCostInfo implementation |
| INLONG-11711 | [Improve][SDK] SortSDK shares the same PulsarClient among different SortTasks to avoid performance bottlenecks caused by too many PulsarClients. |
| INLONG-11706 | [Improve][SDK] Optimize HTTP Sender implementation |
| INLONG-11702 | [Improve][SDK] Optimize Sender factory implementation |
| INLONG-11700 | [Improve][SDK] Optimize TCP message reporting Sender implementation |
| INLONG-11698 | [Improve][SDK] Optimize TCP encode and decode implementation |
| INLONG-11695 | [Improve][SDK] MessageSender related interfaces abstraction |
| INLONG-11692 | [Improve][SDK] The metadata update function abstracted to ConfigHolder |
| INLONG-11689 | [Improve][SDK] Optimize user reporting information management |
| INLONG-11683 | [Improve][SDK] Optimize the functions return of the ProxyConfigManager class |
| INLONG-11680 | [Improve][SDK] Optimize metric-related implementation |
| INLONG-11678 | [Improve][SDK] Optimize the ProxyClientConfig class |
| INLONG-11675 | [Improve][SDK] Optimize IpUtils class related implementation |
| INLONG-11672 | [Improve][SDK] Remove the implementation of org.apache.inlong.sdk.dataproxy.pb.* |
| INLONG-11670 | [Improve][SDK] Rename the ProxysdkException class name to ProxySdkException |
| INLONG-11668 | [Feature][SDK] Add max life time support for the connections in conn pool of Golang SDK |
| INLONG-11663 | [Improve][SDK]Increase the conn pool size for Golang SDK |
| INLONG-11662 | [Improve][SDK]Enable TCP keep alive for Golang SDK |
| INLONG-11661 | [Improve][SDK]Do not mark endpoint unavailable when it is the only one in Golang SDK |
| INLONG-11660 | [Improve][SDK]Close exist conns if initConns() failed in Golang SDK |
| INLONG-11564 | [Improve][SDK] DataProxy SDK Implementation Optimization |
| INLONG-11228 | [Bug][SDK] Limitation of Transform Sql Statement Parser |
| INLONG-10465 | [Improve][SDK] Go SDK pressure test and optimization |
Sort
| ISSUE | Summary |
|---|---|
| INLONG-11841 | [Improve][Sort] When the SortTask is closed, the BufferQueueChannel must be released along with synchronously releasing the GlobalBufferQueue's token |
| INLONG-11836 | [Feature][Sort] Provide SortStandalone flow control to prevent single-task blocking from affecting the normal sorting of other tasks. |
| INLONG-11833 | [Improve][Sort] Appendmode configuration ignores case |
| INLONG-11829 | [Feature][Sort] Optimize MySQL-CDC changelog audit report |
| INLONG-11821 | [Feature][Sort] kv and csv deserialization configuration supports whether to remove and automatically add escape configuration |
| INLONG-11819 | [Feature][Sort] Sort kv/csv format must support keep escape, using line delimiter and call back when parse field has exception. |
| INLONG-11807 | [Feature][Sort] Support exactly metric r... |
2.1.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-11413 | [Improve][Agent] By default, Agent status and file metrics are not reported |
| INLONG-11451 | [Improve][Agent] When the installer detects that the process does not exist, it increases the wait for retry to prevent misjudgment |
| INLONG-11461 | [Improve][Agent] HeartbeatManager does not create a DefaultMessageSender |
| INLONG-11499 | [Improve][Agent] By default, use the locally configured audit address |
| INLONG-11506 | [Improve][Agent] Task start and end time using string type |
| INLONG-11516 | [Improve][Agent] Accelerate the process exit speed |
| INLONG-11518 | [Improve][Agent] Support multiple processes |
| INLONG-11522 | [Improve][Agent] Strictly process new instances in the order of submission |
| INLONG-11524 | [Improve][Agent] Save offset before exiting to reduce data duplication |
| INLONG-11527 | [Improve][Agent] Save both row and byte position information when saving offset |
| INLONG-11529 | [Improve][Agent] Add exception handling for audit SDK |
| INLONG-11556 | [Improve][Agent] Resolve exceptions when saving installation packages |
| INLONG-11558 | [Improve][Agent] Modify the default cluster label of the configuration file |
| INLONG-11560 | [Improve][Agent] Adjust the directory of data source extension plugins |
| INLONG-11562 | [Improve][Agent] Modify the MemoryManager class to support adding semaphore |
| INLONG-11569 | [Improve][Agent] Add COS Task |
| INLONG-11569 | [Improve][Agent] Add COS Task |
| INLONG-11571 | [Improve][Agent] Add classes for actual collection of COS source |
| INLONG-11571 | [Improve][Agent] Add classes for actual collection of COS source |
| INLONG-11574 | [Improve][Agent] Add COS source unit test |
| INLONG-11591 | [Improve][Agent] Reduce duplicate code for log collection type tasks |
| INLONG-11591 | [Improve][Agent] Reduce duplicate code for log collection type tasks |
| INLONG-11614 | [Improve][Agent] The AbstractSource class poses a risk of semaphore leakage |
| INLONG-11624 | [Improve][Agent] Add SQL data source |
Dashboard
| ISSUE | Summary |
|---|---|
| INLONG-11643 | [Feature][Dashboard] The MySQL node password is not required |
| INLONG-11186 | [Improve][Dashboard] Export audit indicator data to csv |
| INLONG-11186 | [Improve][Dashboard] Export audit indicator data to csv |
| INLONG-11187 | [Improve][Dashboard] Agent batch upgrade |
| INLONG-11425 | [Improve][Dashboard] Data preview body field is not differentiated |
| INLONG-11425 | [Improve][Dashboard] Data preview body field is not differentiated |
| INLONG-11441 | [Improve][Dashboard] Add ClusterTag filtering conditions to the cluster interface |
| INLONG-11449 | [Improve][Dashboard] Add clear and search functions to some drop-down boxes |
| INLONG-11449 | [Improve][Dashboard] Add clear and search functions to some drop-down boxes |
| INLONG-11465 | [Improve][Dashboard] The sink drop-down box supports search |
Manager
| ISSUE | Summary |
|---|---|
| INLONG-11361 | [Improve][Manager] Support querying heartbeat information based on IP address |
| INLONG-11368 | [Improve][Manager] Determine whether to issue a streamSource based on the stream status |
| INLONG-11375 | [Improve][Manager] Add a restriction that an IP can only belong to one cluster |
| INLONG-11377 | [Improve][Manager] Add verification for oceanusBase URL |
| INLONG-11387 | [Improve][Manager] Support multi-threaded processing agent installation |
| INLONG-11389 | [Improve][Manager] Installation log display operation time |
| INLONG-11391 | [Improve][Manager] Add openAPI for adding data add tasks |
| INLONG-11397 | [Improve][Manager] Support copy modules.json when installer reinstall |
| INLONG-11402 | [Improve][Manager] Download the installer to a temporary directory |
| INLONG-11415 | [Improve][Manager] Support querying cluster node operation records |
| INLONG-11433 | [Improve][Manager] Add validation for the parameter advertising Address |
| INLONG-11487 | [Improve][Manager] Support adding data add tasks based on the source ID |
| INLONG-11508 | [Improve][Manager] Add APIs to dirty data query |
| INLONG-11513 | [Improve][Manager] Rename configuration names related to dirty data |
| INLONG-11533 | [Improve][Manager] Enable Manager to use multiple scheduling engines simultaneously |
| INLONG-11551 | [Improve][Manager] The interface does not return scheduleEngine, causing the page echo to fail. |
| INLONG-11567 | [Improve][Manager] Optimize the original DAG of Airflow |
| INLONG-11585 | [Improve][Manager] Support JDBC verification under dual write parameters |
| INLONG-11608 | [Improve][Manager] Add permission verification for ordinary users to create streams and sinks |
| INLONG-11618 | [Improve][Manager] Support COS stream source |
| INLONG-11342 | [Feature][Manager] Support Transform Function doc display |
| INLONG-11401 | [Feature][Manager] Support Dolphinscheduler schedule engine |
| INLONG-11400 | [Feature][Manager] Support Airflow schedule engine |
| INLONG-11483 | [Feature][Manager] Support multiple schedule engine |
| INLONG-11531 | [Feature][Manager] Fix bug in DolphinScheduler engine |
| INLONG-11535 | [Feature][Manager] Enhance schedule engine config |
| INLONG-11366 | [Bug][Manager] Data preview error handling line delimiter |
| INLONG-11412 | [Bug][Manager] Failed to handle request on path: /inlong/manager/openapi/dataproxy/getIpList/inlong_agent_system by user: admin |
SDK
| ISSUE | Summary |
|---|---|
| INLONG-10873 | [Feature][SDK] Transform support factorial function |
| INLONG-11002 | [Feature][SDK] Transform SQL support Fibonacci function |
| INLONG-11051 | [Feature][SDK] Transform SQL supports parsing of in & any & some & all |
| INLONG-11302 | [Feature][SDK] Transform SQL supports "JSON_INSERT" function |
| INLONG-11303 | [Feature][SDK] Transform SQL supports "JSON_REMOVE" function |
| INLONG-11304 | [Feature][SDK] Transform SQL supports "JSON_REPLACE" function |
| INLONG-11305 | [Feature][SDK] Transform SQL supports "JSON_SET" function |
| INLONG-11372 | [Feature][SDK] LocalTimeFunctionTest may fail in some situation |
| INLONG-11382 | [Feature][SDK] Optimize all columns select of Transform SDK |
| INLONG-11546 | [Feature][SDK] Support async and sync report dirty data |
| INLONG-11611 | [Feature][SDK] Transform SDK supports RowData source and sink |
| INLONG-11616 | [Feature][SDK] Use self-defined Field and RowData conversion utils |
| INLONG-11352 | [Improve][SDK] Add dirty data collection sdk |
| ... |
2.0.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-10286 | [Improve][Agent] Update the MQTT Source |
| INLONG-10287 | [Improve][Agent] Update the Redis Source |
| INLONG-10288 | [Improve][Agent] Update the Oracle Source |
| INLONG-10289 | [Improve][Agent] Update the SQLServer Source |
| INLONG-10742 | [Improve][Agent] Set the formatting of unix timestamp for SQLServerSource as optional |
| INLONG-10749 | [Improve][Agent] Local DB instance records may leak |
| INLONG-10751 | [Improve][Agent] Agent needs to report process status for backend problem analysis |
| INLONG-10756 | [Improve][Agent] Report file metrics for backend problem analysis |
| INLONG-10761 | [Improve][Agent] Delete reader related code |
| INLONG-10770 | [Improve][Agent] Delete audit proxy configuration related code |
| INLONG-10889 | [Improve][Agent] When detecting oom, it is recommended to exit the process |
| INLONG-11135 | [Improve][Agent] Support filtering capability when supplementing data |
| INLONG-11145 | [Improve][Agent] Data supplementation needs optimization |
| INLONG-11179 | [Improve][Agent] Delete useless code |
| INLONG-11298 | [Improve][Agent] Pulsar source needs to do some exception handling |
| INLONG-11306 | [Improve][Agent] Modify the naming of variables in the redis source |
| INLONG-11327 | [Improve][Agent] No longer retrieve extend class from task configuration |
| INLONG-11333 | [Improve][Agent] Retrieve IP from configuration file during audit reporting |
| INLONG-11175 | [Bug][Agent] The current MqttSource solution may cause message loss |
Dashboard
| ISSUE | Summary |
|---|---|
| INLONG-10632 | [Feature][Dashboard] dashboard should support oceanbase |
| INLONG-10693 | [Improve][Dashboard] Added custom ASCII code option for source data field separator |
| INLONG-10779 | [Improve][Dashboard] Data synchronization adds offline synchronization configuration |
| INLONG-10783 | [Improve][Dashboard] Add enableCreateResource field to all sinks |
| INLONG-10787 | [Improve][Dashboard] Update missing i18n item |
| INLONG-10839 | [Improve][Dashboard] Data preview style structure modification |
| INLONG-10844 | [Improve][Dashboard] Resource details page sort information interface switch |
| INLONG-10846 | [Improve][Dashboard] Add cluster name to data source information display |
| INLONG-10847 | [Improve][Dashboard] Cluster node management adds heartbeat display page |
| INLONG-10910 | [Improve][Dashboard] Sort info Modify some field names |
| INLONG-11178 | [Improve][Dashboard] Added http sink and http node |
| INLONG-11183 | [Improve][Dashboard] Module audit page indicator items are merged with other items |
| INLONG-11197 | [Improve][Dashboard] Add delete button to cluster management and template management |
| INLONG-11204 | [Improve][Dashboard] agent node hidden port number |
| INLONG-11210 | [Improve][Dashboard] Version management removes related interface calls and adds default values |
| INLONG-10572 | [Bug][Dashboard] The Approvals page appears "Something went wrong" |
| INLONG-10947 | [Bug][Dashboard] Modify field description missing for English locale |
| INLONG-10973 | [Bug][Dashboard] A wrong error occurs in data preview |
Manager
| ISSUE | Summary |
|---|---|
| INLONG-10703 | [Feature][Manager] Manager should support oceanbase |
| INLONG-10723 | [Improve][Manager] Update base64 encoder |
| INLONG-10758 | [Improve][Manager] Support obtaining serialization configuration when wrapType is raw |
| INLONG-10834 | [Improve][Manager] Standalone configuration supports Tube MQ |
| INLONG-10856 | [Improve][Manager] Support agent installation logs |
| INLONG-10884 | [Improve][Manager] Support configuring HTTP type sink |
| INLONG-10907 | [Improve][Manager] Support reinstalling the installer |
| INLONG-10911 | [Improve][Manager] Support pagination to query sort task details information |
| INLONG-10931 | [Improve][Manager] Data preview supports data containing escape characters |
| INLONG-10954 | [Improve][Manager] Support fields of timestamptz type |
| INLONG-10977 | [Improve][Manager] Data preview supports escaping for KV data type |
| INLONG-10988 | [Improve][Manager] Data preview filters data in tubes based on streamId |
| INLONG-11089 | [Improve][Manager] Optimize Sort filter function |
| INLONG-11091 | [Improve][Manager] Manager supports in filter function configuration |
| INLONG-11103 | [Improve][Manager] Data add task supports filtering based on stream |
| INLONG-11157 | [Improve][Manager] Asynchronous processing agent installation |
| INLONG-11195 | [Improve][Manager] It is not allowed to modify group information when ordinary users are not responsible |
| INLONG-11313 | [Improve][Manager] Dataproxy cluster increases maximum packet length configuration |
| INLONG-11323 | [Improve][Manager] Modify the parameters of the data add tasks for file collection |
| INLONG-11335 | [Improve][Manager] Move maxPacketLength to the DataProxyNodeResponse |
| INLONG-10730 | [Bug][Manager] Auto-assign wrong Sortstandalone cluster when no cluster is under the tag |
| INLONG-10754 | [Bug][Manager] Offline data sync may create too many scheduling instances at the start point |
| INLONG-10763 | [Bug][Manager] Exception occurs when get or update offline sync group information |
| INLONG-10842 | [Bug][Manager] Tube cluster address not obtained when obtaining consumer group information |
| INLONG-10918 | [Bug][Manager] The correct command was not used when reinstalling the installer |
| INLONG-10921 | [Bug][Manager] Task configuration not deleted when deleting streamSource |
| INLONG-10975 | [Bug][Manager] When saving the group, only the existence of the groupid under the current tenant was verified |
| INLONG-10997 | [Bug][Manager] Incorrect setting of transformSQL in dataflowconfig |
| INLONG-11071 | [Bug][Manager] Failed to handle request on inlong_agent_system by admin |
| INLONG-11095 | [Bug][Manager]Data preview field misalignment |
| INLONG-11142 | [Bug][Manager] Data add task not scheduled for cleaning |
| INLONG-11150 | [Bug][Manager] Incorrect setting of sorTaskName for sink |
| INLONG-11153 | [Bug][Manager] HTTP sink does not automatically allocate sort cluster |
| INLONG-11163 | [Bug][Manager] Adding dataaddtask failed |
| INLONG-11307 | [Bug][Manager] Unable to obtain extparams from multiple data sources |
SDK
| ISSUE | Summary |
|---|---|
| INLONG-10119 | [Feature][SDK] Supporting Data Sharding with GroupBy Semantics |
| INLONG-10128 | [Feature][SDK] Support to parse Map node in JSON or PB protocol data |
| INLONG-10464 | [Feat... |
1.13.0
Agent
ISSUE |
Summary |
|---|---|
| INLONG-10094 | [Improve][Agent] The task record for data supplementation has not expired |
| INLONG-10107 | [Improve][Agent] There is a bug in updating the module configuration |
| INLONG-10113 | [Improve][Agent] Delete useless code |
| INLONG-10115 | [Improve][Agent] Offset needs to be changed to save in string format because some data sources have non integer positions |
| INLONG-10187 | [Improve][Agent] Need to handle situations where timeoffset is empty, default to no offset |
| INLONG-10189 | [Improve][Agent] There is a risk of agent getting stuck after SDK initialization exception |
| INLONG-10191 | [Improve][Agent] Delete useless code |
| INLONG-10210 | [Improve][Agent] The installer needs to add a script for environment initialization |
| INLONG-10268 | [Improve][Agent] Suggest not using task ID as the data version |
| INLONG-10281 | [Improve][Agent] Real time collection of files with audit data errors |
| INLONG-10298 | [Improve][Agent] The command related code is no longer useful, it is recommended to delete it |
| INLONG-10302 | [Improve][Agent] The Task base class needs to add an interface that limits the number of instances obtained |
| INLONG-10318 | [Feature][Agent] Add PostgreSQL data source for Agent |
| INLONG-10319 | [Improve][Agent] Agent should get audit id from audit sdk |
| INLONG-10384 | [Improve][Agent] Add functions to the Store interface to extend new storage plugins |
| INLONG-10399 | [Improve][Agent] Add global configurations updater |
| INLONG-10410 | [Improve][Agent] Add ZK plugin to save offset info |
| INLONG-10443 | [Improve][Agent] Put Rocksdb into the plugins module |
| INLONG-10446 | [Improve][Agent] Adjusting audit SDK address settings |
| INLONG-10476 | [Improve][Agent] The audit address should only be obtained from the manager |
| INLONG-10535 | [Improve][Agent] Support minute level tasks |
| INLONG-10542 | [Improve][Agent] Remove the deleted watch directions |
| INLONG-10547 | [Improve][Agent] Provide a clear prompt after the mq type is incorrect |
| INLONG-10564 | [Improve][Agent] Request configuration with md5 included |
| INLONG-10598 | [Improve][Agent] Delete excess unit tests |
| INLONG-10611 | [Improve][Agent] Update configuration only when the version number is increased |
| INLONG-10633 | [Improve][Agent] The initialization function of AuditUtils needs to pass in the configuration |
| INLONG-10645 | [Improve][Agent] Installer needs to add process protection |
| INLONG-10650 | [Improve][Agent] When the installer updates the configuration, it is necessary to first determine the version |
Dashboard
ISSUE |
Summary |
|---|---|
| INLONG-10179 | [Bug][Dashboard] There are redundant All types in cluster management |
| INLONG-10226 | [Bug][Dashboard] Audit items cannot be searched |
| INLONG-10256 | [Improve][DashBoard] Modify the data source IP item of the file data source form in the data access module |
| INLONG-10314 | [Improve][DashBoard] Add an operation time to the operation log table |
| INLONG-10347 | [Improve][Dashboard] Add Agent IP field to PostgreSQL data source |
| INLONG-10350 | [Bug][Dashboard] Audit item search failed |
| INLONG-10377 | [Improve][DashBoard] add Source Data Field Template |
| INLONG-10394 | [Improve][DashBoard] Agent page modifies the version and sets the default values for the commands |
| INLONG-10409 | [Feature][Dashboard] Support installing agents by SSH key-based authentication |
| INLONG-10417 | [Bug][Dashboard] There is an issue with the MODE display on the approval screen, and data synchronization is not displayed |
| INLONG-10419 | [Feature][Dashboard] Automatically switch tenants when opening a page with groupId |
| INLONG-10449 | [Bug][Dashboard] The field template for selecting a new data flow does not take effect |
| INLONG-10468 | [Feature][Dashboard] Audit data showing totals and variances |
| INLONG-10500 | [Improve][Dashboard] When you edit tenants in a template, you need to change the scope to hide them |
| INLONG-10501 | [Improve][Dashboard] Modify component type to be more intuitive |
| INLONG-10504 | [Improve][Dashboard] Added details button to tag management |
| INLONG-10584 | [Improve][Dashboard] New cluster type adds sortkafka types |
| INLONG-10592 | [Improve][Dashboard] When there are too many selections in the drop-down box, omit some of them |
| INLONG-10614 | [Improve][Dashboard] The template list does not need to display Id |
| INLONG-10617 | [Improve][Dashboard] The mq type should not exist on the data synchronization page |
| INLONG-10620 | [Bug][Dashboard] Page error occurs wrong |
| INLONG-10640 | [Improve][Dashboard] Approval page display item modification |
| INLONG-10651 | [Improve][Dashboard] File Type data stream supports minute-level periods |
| INLONG-10681 | [Bug][Dashboard] There is a nesting problem in moduleIdList |
| INLONG-10691 | [Improve][Dashboard] Added monitoring and auditing page |
Tube
ISSUE |
Summary |
|---|---|
| INLONG-10126 | [Bug][tubemq-server] Maven sleepycat je.version 7.3.7 can not found in maven repository |
DataProxy
ISSUE |
Summary |
|---|---|
| INLONG-10066 | [Improve][DataProxy] Optimize the related configuration settings in the CommonConfigHolder.java file |
| INLONG-10067 | [Improve][DataProxy] Simplify the configuration and acquisition of the Manager address |
| INLONG-10080 | [Improve][DataProxy] DataProxy implementation optimization |
| INLONG-10081 | [Improve][DataProxy] Modify the data format of metadata saved in the metadata.json file |
| INLONG-10102 | [Improve][Dat... |
1.12.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-9801 | [Umbrella][Agent] Add an agent installer module for agent installation |
| INLONG-9698 | [Improve][Agent] Optimize file collection initialization logic toIO |
| INLONG-9700 | [Improve][Agent] Optimize the message ack logic to reduce semaphore competition. |
| INLONG-9702 | [Improve][Agent] Change the data transmission interval to depend on local file configuration |
| INLONG-9704 | [Improve][Agent] Modify the default value of memory control semaphores to adapt to businesses with large amounts of data |
| INLONG-9710 | [Improve][Agent] Improve the accuracy of instance heartbeat auditing |
| INLONG-9712 | [Improve][Agent] Adjusting task configuration verification logic |
| INLONG-9714 | [Improve][Agent] SQL injection in pgjdbc |
| INLONG-9716 | [Improve][Agent] Delete useless code when storing tasks |
| INLONG-9721 | [Improve][Agent] Add a common cycle parameter to the task configuration |
| INLONG-9736 | [Improve][Agent] Make time zone a common parameter |
| INLONG-9772 | [Improve][Agent] Increase auditing for sending exceptions and resending |
| INLONG-9798 | [Improve][Agent] Add type for agent installer |
| INLONG-9802 | [Improve][Agent] Add an agent installer module for agent installation |
| INLONG-9806 | [Improve][Agent] Add installer configuration file |
| INLONG-9816 | [Improve][Agent] Add config class for installer |
| INLONG-9829 | [Improve][Agent] Add guardian scripts |
| INLONG-9831 | [Improve][Agent] Increase configuration acquisition capability |
| INLONG-9833 | [Improve][Agent] Add module state to distinguish whether the module has been downloaded or installed |
| INLONG-9844 | [Improve][Agent] Add agent installer config request class |
| INLONG-9848 | [Improve][Agent] Add the getAuthHeader function in the HttpManager class |
| INLONG-9850 | [Improve][Agent] Add a function to retrieve HttpManager in the ModuleManager class |
| INLONG-9852 | [Improve][Agent] Place the configuration item for the installation package storage path in the installation package configuration |
| INLONG-9858 | [Improve][Agent] Increase local read and write capabilities for module config |
| INLONG-9859 | [Improve][Agent] Increase installation package download capability and local MD5 computing power |
| INLONG-9863 | [Improve][Agent] To avoid data loss caused by too many supplementary files |
| INLONG-9889 | [Improve][Agent] Delete test code |
| INLONG-9906 | [Improve][Agent] Add configuration comparison logic and processing of comparison results |
| INLONG-9909 | [Improve][Agent] Add unit test for installer |
| INLONG-9910 | [Improve][Agent] Increase daily verification for process monitoring, reinstallation, or re downloading |
| INLONG-9922 | [Improve][Agent] Add a configuration copy script to copy the configuration from the installer to the agent |
| INLONG-9946 | [Improve][Agent] Verify the return code, only proceed with the subsequent process if the return code is successful |
| INLONG-9948 | [Improve][Agent] The instance class has many code similarities, abstract a common class |
| INLONG-9955 | [Improve][Agent] Rename Job to Task |
| INLONG-9969 | [Improve][Agent] Release the memory semaphore of the source only when the data is placed in the queue |
| INLONG-9982 | [Improve][Agent] Adjusting the abstraction of source code to facilitate rapid addition of sources |
| INLONG-9983 | [Improve][Agent] Renew the doc of adding sources |
| INLONG-9987 | [Improve][Agent] Fix the issue of deleting the first digit whent0 ... |
1.11.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-9457 | [Improve][Agent] Add task and instance heartbeat audit |
| INLONG-9481 | [Improve][Agent] Add unit test of reading with offset |
| INLONG-9580 | [Improve][Agent] Add unit testing to taskmanager to test their ability to recover tasks from DB |
| INLONG-9614 | [Improve][Agent] Change folder name |
| INLONG-9467 | [Improve][Agent] Improve code exception detection to ensure task and instance state transitions |
| INLONG-9454 | [Improve][Agent] Increase exit conditions to prevent dead loops |
| INLONG-9556 | [Improve][Agent] Prevent thread freeze caused by deleting data sources when the backend cannot send out |
| INLONG-9572 | [Improve][Agent] Set data time of message cache by sink data time |
| INLONG-9548 | [Improve][Agent] Supports HTTPS and can determine whether to enable it through configuration |
| INLONG-9600 | [Improve][Agent]Adjust the sinks directory for code consistency |
Dashboard
| ISSUE | Summary |
|---|---|
| INLONG-9627 | [Improve][Dashboard] Audit and transmission delay filtering query optimization |
| INLONG-9543 | [Improve][Dashboard] Cls, Pulsar and es sink support saving sortTaskName and sortConsumerGroup |
| INLONG-9610 | [Improve][Dashboard] Cluster creation type optimization |
| INLONG-9495 | [Improve][Dashboard] Data synchronization basic information page optimization |
| INLONG-9663 | [Improve][Dashboard] Data synchronization doris sink supports append Mode |
| INLONG-9530 | [Improve][Dashboard] Dataproxy cluster nodes support adding the enabledOnline parameter |
| INLONG-9505 | [Improve][Dashboard] Pulsar source parameter optimization |
| INLONG-9516 | [Improve][Dashboard] Remove useless dependencies |
| INLONG-8393 | [Improve][DataProxy] Optimize the HeartbeatManager class |
| INLONG-9657 | [Feature][Dashboard] Support management of Doris data node |
| INLONG-9439 | [Feature][Dashboard] Support module reconciliation function |
| INLONG-9550 | [Feature][Dashboard] System operation and maintenance supports query and audit through Gorupid and Stream id |
| INLONG-9489 | [Bug][Dashboard] Transform remove missing stream id |
Manager
| ISSUE | Summary |
|---|---|
| INLONG-9508 | [Feature][Manager] Add Iceberg field type mapping strategy to improve usability |
| INLONG-9634 | [Feature][Manager] Auto assgin sort task and consumer group of standalone export |
| INLONG-9056 | [Feature][Manager] Configuration change detection |
| INLONG-9524 | [Feature][Manager] Manager client support migrate group tenant |
| INLONG-9452 | [Improve][Manager] Add audit items for file agent |
| INLONG-9484 | [Improve][Manager] Improve logic of sortstandalone sink auto-assigned cluster |
| INLONG-9441 | [Improve][Manager] MySQL data source supports both full and incremental modes |
| INLONG-8392 | [Improve][Manager] Optimize the HeartbeatMsg class |
| INLONG-9586 | [Improve][Manager] Provide installation agent framework |
| INLONG-9528 | [Improve][Manager] Support configuring the switch to enable dataproxy nodes |
| INLONG-9591 | [Improve][Manager] Support printing thread status before submitting tasks |
| INLONG-9523 | [Improve][Manager] Support querying all audit information based on IP address |
| INLONG-9440 | [Improve][Manager] Support querying audit information based on ip |
| INLONG-9518 | [Improve][Manager] Support resetting the consumption location of the consumption group used by sort |
| INLONG-9475 | [Improve][Manager] Support setting dataNode when configuring streamSource for MYSQL |
| INLONG-9533 | [Improve][Manager] Support setting dataNode when configuring streamSource for Pulsar/Iceberg/PostgreSQL |
| INLONG-9510 | [Improve][Manager] Supports doris database synchronization |
| INLONG-9503 | [Improve][Manager] Unified Hashmap Dependency Package |
| INLONG-9577 | [Bug][Manager] Datatime field type conversion error |
| INLONG-9204 | [Bug][Manager] Failed to use PostgreSQL sink |
| INLONG-9470 | [Bug][Manager] Failed to verify if the namespace exists |
| INLONG-9461 | [Bug][Manager] Failure of GroupTaskListenerFactoryTest |
| INLONG-9618 | [Bug][Manager] HttpUtils did not process 307 status code |
| [INLONG-9606](https://github.com/ap... |
1.10.0
1.10.0-RC0
This tag was signed with the committer’s verified signature.
vernedeng
vernedeng
Agent
| ISSUE | Summary |
|---|---|
| INLONG-9089 | [Improve][Agent] Add enums for task and instance |
| INLONG-9091 | [Improve][Agent] Add offset profile |
| INLONG-9094 | [Umbrella][Agent] Reconfiguration of task management |
| INLONG-9102 | [Improve][Agent] Add file utils |
| INLONG-9112 | [Improve][Agent] Add task and instance profile |
| INLONG-9117 | [Improve][Agent] Rewrite class RocksDbImp to enable it to be constructed with a child path |
| INLONG-9120 | [Improve][Agent] Add offset db to store the offset data |
| INLONG-9122 | [Improve][Agent] Add task and instance action |
| INLONG-9124 | [Improve][Agent] Add task and instance db |
| INLONG-9125 | [Improve][Agent] Add offset manager |
| INLONG-9132 | [Improve][Agent] Add file used message cache |
| INLONG-9134 | [Improve][Agent] Add file related utils |
| INLONG-9136 | [Improve][Agent] Add instance manager |
| INLONG-9138 | [Improve][Agent] Add task manager |
| INLONG-9143 | [Improve][Agent] Add log file collect task |
| INLONG-9149 | [Improve][Agent] Add sender manager for file collect |
| INLONG-9151 | [Improve][Agent] Add log file source and source related modification |
| INLONG-9155 | [Improve][Agent] Add file used proxy |
| INLONG-9159 | [Improve][Agent] Add file instance |
| INLONG-9161 | [Improve][Agent] Modify left sink |
| INLONG-9163 | [Improve][Agent] Delete trigger related file |
| INLONG-9165 | [Improve][Agent] Delete job related file |
| INLONG-9182 | [Improve][Agent] Delete useless code |
| INLONG-9187 | [Improve][Agent] Delete useless memory manager |
| INLONG-9190 | [Bug][Agent] Log file source clear buffer queue does not take effect |
| INLONG-9194 | [Bug][Agent] Calc time offset failed if the param is 0 |
| INLONG-9200 | [Bug][Agent] Duplicate file collect instance |
| INLONG-9207 | [Bug][Agent] Task manager stuck |
| INLONG-9214 | [Improve][Agent] Limit max file count to collect once |
| INLONG-9215 | [Improve][Agent] Add predefine fields |
| INLONG-9233 | [Bug][Agent] Fix bug: source, proxy, sender get stuck |
| INLONG-9237 | [Improve][Agent] Move addictive fields to package attributes |
| INLONG-9241 | [Improve][Agent] Print task and instance detail every ten seconds |
| INLONG-9244 | [Bug][Agent] Fix bug: miss file from next data time |
| INLONG-9253 | [Bug][Agent] Get byte position of file by line count offset failed |
| INLONG-9263 | [Improve][Agent] Print the statistics of task and instance not detail |
| INLONG-9265 | [Improve][Agent] Add audit of agent send success |
| INLONG-9267 | [Bug][Agent] Data loss when there are many files to read once |
| INLONG-9284 | [Improve][Agent] Report audit by data time not real time |
| INLONG-9286 | [Improve][Agent] Adjust the time offset calculation function |
| INLONG-9289 | [Improve][Agent] Improve the completion judgment logic of collecting instances |
| INLONG-9300 | [Improve][Agent] Divide data time into source time and sink time |
| INLONG-9308 | [Improve][Agent] The sink end of the file instance supports sending data with different streamIds |
| INLONG-9310 | [Improve][Agent] Add extended handler in file source |
| INLONG-9312 | [Improve][Agent] Add data content style |
| INLONG-9315 | [Improve][Agent] Convert data time from source time zone to sink time zone. |
| INLONG-9317 | [Improve][Agent] Print basic info of hearbeat |
| INLONG-9335 | [Improve][Agent] Bring cycle parameters when creating an instance |
| INLONG-9338 | [Improve][Agent] Real time file collection uses the current time as the data time |
| INLONG-9347 | [Improve][Agent] Check task profile before save into db |
| INLONG-9364 | [Improve][Agent] Remove expired instance from db |
| INLONG-9366 | [Improve][Agent] Remove useless offset record |
| INLONG-9369 | [Improve][Agent] Increase sending failure audit and real-time audit |
| INLONG-9375 | [Improve][Agent] Modify the agent's real-time audit id to prevent duplication |
| INLONG-9390 | [Improve][Agent] Collect supplementary data in chronological order |
| INLONG-9397 | [Improve][Agent] Do not directly delete the instance records of the local db when stopping the instances |
1.9.0
Agent
| ISSUE | Summary |
|---|---|
| INLONG-8850 | [Improve][Agent] Remove unregister of MetricRegister when taskmanager is initialized |
| INLONG-8655 | [Bug][Agent] JobWrapper thread leaks when the job is stopped |
| INLONG-8652 | [Improve][Agent] Delete the capacity of setting blacklist |
| INLONG-8649 | [Bug][Agent] Thread leaks for ProxySink when the DataProxy SDK init failed |
| INLONG-8647 | [Improve][Agent] Stop sending task snapshot to Manager module |
| INLONG-8645 | [Improve][Agent] Delete the capacity of the loading trigger for local files |
| INLONG-8629 | [Bug][Agent] Sending invalid data to DataProxy failed blocks normal data sending |
| INLONG-8524 | [Improve][Agent] Update the JVM Options for Agent |
| INLONG-8520 | [Bug][Agent] File agent sent data to dataproxy was all json formatted 1.9.x/bugfix |
| INLONG-8146 | [Improve][Agent] Optimize agent-env.sh, and '-XX:NativeMemoryTracking' |
| INLONG-8799 | [Bug][Manager][Agent][DataProxy] The "opentelemetry" related configs may affect the startup of services |
| INLONG-8611 | [Feature][Manager][Agent][DataProxy] Support full link tracking to improve the observability of the project |
Audit
| ISSUE | Summary |
|---|---|
| INLONG-8836 | [Improve][Audit] Add audit_tag information to distinguish data sources and data targets |
| INLONG-8753 | [Improve][Audit] Separate commons-text from org.apache.flume |
| INLONG-8699 | [Improve][Audit] Optimize the service log of audit-proxy |
| INLONG-8642 | [Improve][Audit] Remove the audit commons-text dependency |
Dashboard
| ISSUE | Summary |
|---|---|
| INLONG-8882 | [Feature][Dashboard] Support management of Pulsar data node |
| INLONG-8881 | [Feature][Dashboard] Support management of Pulsar sink |
| INLONG-8843 | [Improve][Dashboard] StarRocks sink field optimization |
| INLONG-8841 | [Feature][Dashboard] Support management of Iceberg sources |
| INLONG-8810 | [Improve][Dashboard] Approval management process ID link optimization |
| INLONG-8800 | [Improve][Dashboard] Owners search component optimization |
| INLONG-8788 | [Improve][Dashboard] Data synchronization page optimization |
| INLONG-8779 | [Improve][Dashboard] Modify password verification optimization |
| INLONG-8760 | [Bug][Dashboard] The transform button was not at the center |
| INLONG-8757 | [Improve][Dashboard] Implement buttons using a link good first issue |
| INLONG-8755 | [Improve][Dashboard] Data synchronization field mapping optimization |
| INLONG-8727 | [Improve][Dashboard] Approval management Application details optimization |
| INLONG-8705 | [Improve][Dashboard] Source and sink title optimization |
| INLONG-8693 | [Feature][Dashboard] Data synchronization supports Audit |
| INLONG-8661 | [Bug][DashBoard] DatabaseWhiteList is required which is inconsistent with tips |
| INLONG-8624 | [Bug][Dashboard] Tenant Management Search Tenant Exceptions |
| INLONG-8621 | [Feature][Dashboard] Approval management supports approval data synchronization |
| INLONG-8575 | [Improve][Dashboard] Tenant management query optimization |
| INLONG-8560 | [Bug][Dashboard] No username and password when configuring hive. |
| INLONG-8548 | [Feature][Dashboard] Data access supports displaying transmission delay |
| INLONG-8546 | [Bug][Dashboard] Inlong group resource details display error good first issue |
| INLONG-8512 | [Bug][Dashboard] Create tube consumer failed when selecting topic 1.9.x/bugfix |
| INLONG-8502 | [Bug][Dashboard] Query data preview interface exception |
| INLONG-8500 | [Bug][Dashboard] Fix stream data preview url error |
| INLONG-8008 | [Improve][Dashboard] Add default icon for different data nodes good first issue |
DataProxy
| ISSUE | Summary |
|---|---|
| INLONG-8914 | [Improve][DataProxy] Optimize DataProxy event statistics ... |
Contributors
OverRide
Assets 14
1.8.0
Release Notes
Agent
| ISSUE | Summary |
|---|---|
| INLONG-8176 | [Improve][Agent] Upgrade rocksdb version |
| INLONG-8180 | [Improve][Agent] Improve the efficiency and safety of log file reading |
| INLONG-8183 | [Improve][Agent] Optimize agent UT |
| INLONG-8244 | [Bug][Agent] Thread leaks after the job is finished |
| INLONG-8251 | [Improve][Agent] Add global memory limit for file collect |
| INLONG-8334 | [Improve][Agent] Optimize the file collection UT |
| INLONG-8339 | [Improve][DataProxy][Agent] Enable audit by default in DataProxy and Agent |
| INLONG-8347 | [Improve][Agent] Optimize the agent UT of testTimeOffset |
| INLONG-8352 | [Improve][Agent] Optimize the agent UT of testRestartTriggerJobRestore |
| INLONG-8376 | [Improve][Agent] Optimize the agent UT of TestTriggerManager |
DataProxy
| ISSUE | Summary |
|---|---|
| INLONG-4961 | [Feature][DataProxy] Golang SDK |
| INLONG-7194 | [Improve][DataProxy] Migrate index log statistics for the new mq layer |
| INLONG-7766 | [Bug][SDK] Adjusted frame length exceeds occurred when reporting data through the HTTP protocol |
| INLONG-7950 | [Improve][DataProxy] Optimize the implementation logic of the Source |
| INLONG-8049 | [Improve][DataProxy] Add CIDR configuration in the BlackList and WhiteList |
| INLONG-8073 | [Improved][DataProxy]Add HTTP message processing logic in source2 |
| INLONG-8106 | [Improve][DataProxy] Optimize ConfigManager implementation ( part one ) |
| INLONG-8132 | [Improve][DataProxy] Fix Golang SDK typo errors in readme.md and options.go |
| INLONG-8161 | [Improve][DataProxy] Optimize BatchPackProfile related classes implementation |
| INLONG-8163 | [Improve][Manager][DataProxy] Make DataProxy config interface compatible with old versions |
| INLONG-8167 | [Improve][DataProxy]Update Golang SDK dependent packages to fix dependabot alerts |
| INLONG-8192 | [Bug][DataProxy] The topic name generated by dataproxy is incorrect |
| INLONG-8212 | [Improve][DataProxy] Improve HTTP related message handling |
| INLONG-8228 | [Improve][DataProxy] Optimize the implementation of the index output to files |
| INLONG-8252 | [Improve][DataProxy] Adjust default Topic settings from Source to Sink |
| INLONG-8267 | [Improve][DataProxy] Add the control of whether to retry and the count of retries for the failure message |
| INLONG-8284 | [Improve][DataProxy] Unify the message encoding definition of DataProxy |
| INLONG-8294 | [Improve][DataProxy] Optimize the log output in the Sink module |
| INLONG-8305 | [Improve][DataProxy] Optimize HttpPost object creation |
| INLONG-8311 | [Improve][DataProxy] Add event handling support for FlumeEvent type |
| INLONG-8318 | [Improve][DataProxy] Change notification synchronization through condition variables and locks |
| INLONG-8323 | [Improve][DataProxy] Add Topic detailed information output when Producer is null |
| INLONG-8332 | [Improve][DataProxy] Return original content for MSG_ORIGINAL_RETURN type messages |
| INLONG-8339 | [Improve][DataProxy][Agent] Enable audit by default in DataProxy and Agent |
| INLONG-8356 | [Improve][DataProxy] Replace source2 to source |
| INLONG-8368 | [Bug][DataProxy] Sink does not have audit data |
| INLONG-8385 | [Improve][DataProxy] Add take method in BufferQueue class |
| INLONG-8459 | [Improve][DataProxy] Fix code scanning alert - Implicit narrowing conversion in compound assignment |
TubeMQ
| ISSUE | Summary |
|---|---|
| INLONG-4968 | [Feature][TubeMQ] Golang SDK for Producing Message |
| INLONG-8122 | [Feature][TubeMQ] Add "Heartbeat" method for GO SDK |
| INLONG-8165 | [Feature][TubeMQ] Add "SendMessage" method for GO SDK |
| INLONG-8286 | [Improve][TubeMQ] Supports the return package type when querying messages |
| INLONG-8321 | [Improve][TubeMQ] Improve the precision of tube consumer id |
Manager
| ISSUE | Summary |
|---|---|
| INLONG-7914 | [Feature][Manager] Support multi-tenancy |
| INLONG-8024 | [Improve][Manager] Add extended properties when getting the status of the sort task info |
| INLONG-8035 | [Bug][Manager] Non-file tasks cannot be recovered from the heartbeat timeout state |
| INLONG-8039 | [Improve][Manager] Optimize the transform interface |
| INLONG-8047 | [Improve][Dashboard][Manager][Sort] Rename lightweight to DataSync |
| INLONG-8066 | [Improve][Manager] Add sort extended properties when getting the status info of the InlongGroup |
| INLONG-8068 | [Feature][Manager] Support repeatable read for http request |
| INLONG-8072 | [Bug][Manager] NPE when sort_task_name of stream_sink table is empty or null |
| INLONG-8080 | [Bug][Manager] The total parameter found on the page is different from the actual value |
| INLONG-8087 | [Feature][Manager] Add definition of Inlong t... |