Skip to main content
3,475 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
3 votes
1 answer
77 views

I am trying to resample a pandas dataframe, and for some columns I would like to sum on. additionally, I want to get None/nan as result when there is no rows in a resampling period. For aggregation on ...
KamiKimi 3's user avatar
  • 97
-1 votes
1 answer
55 views

I am currently working on a data analysis task in DolphinDB where I need to perform column-wise aggregation on array vectors that store level - 10 bid/ask data. Specifically, I have data for bid ...
user31077149's user avatar
  • 35
1 vote
1 answer
107 views

I’m planning to use ClickHouse to calculate wallet balances based on transactions in my base table. However, there’s an issue: if something goes wrong and I end up inserting the same transactions into ...
Amirhossein Masihi's user avatar
  • 11
0 votes
1 answer
141 views

I'm working with Google BigQuery and I have a table with two numeric columns: grade1 and grade2. I want to calculate the total sum of both columns combined (row-wise) and then find the average of ...
Mahbub Ar Rashid's user avatar
  • 11
2 votes
1 answer
135 views

I have a huge dataframe with 3B rows. I'm running the PySpark code below with the Spark config. spark = SparkSession\ .builder\ .appName("App")\ .config("spark....
Rayne's user avatar
  • 15.2k
0 votes
0 answers
79 views

I have a PySpark dataframe that contains 100M rows. I'm trying to do a series of aggregations on multiple columns, after a groupby. df_agg = df.groupby("colA","colB","colC&...
Rayne's user avatar
  • 15.2k
5 votes
2 answers
174 views

I have a proprietary file format definition that contains a header format: class Header { public: uint32_t checksum; uint16_t impedance; uint16_t type_of_data; uint32_t ...
Thomas Matthews's user avatar
  • 58.1k
1 vote
1 answer
140 views

In Vega or Vega lite, I want to create a stacked area chart where I can change the field used to color the visualization. Here is an example visualization. In this example, I would like to be able ...
Jay Askren's user avatar
  • 10.5k
2 votes
1 answer
82 views

I would like to run groupby and aggregation over a dataframe where the aggregation joins strings with the same id. The df looks like this: In [1]: df = pd.DataFrame.from_dict({'id':[1,1,2,2,2,3], '...
Dave's user avatar
  • 501
2 votes
2 answers
150 views

I have modeled the relationship between LeaseAgreement and Person as an aggregation. The '1' on the Person side is meant to indicate that each LeaseAgreement has exactly one reference to a Person (in ...
Z.J's user avatar
  • 391
0 votes
2 answers
125 views

I'm using StringAgg and order as follows: # Get order column & annotate with list of credits if request.POST.get('order[0][name]'): order = request.POST['order[0][name]'] ...
bur's user avatar
  • 899
0 votes
0 answers
54 views

I want to aggregate the values of my DataStream in tumbling windows of 10 seconds. Unfortunately is the documentation in Bytewax very limited and I also don't find any other source where an average of ...
LeXXan's user avatar
  • 27
0 votes
0 answers
70 views

We have a query calculating number of terms on multiple fields. { "query": { "bool": { "filter": [ { "term": { "...
Lukáš Křečan's user avatar
  • 14.4k
4 votes
2 answers
241 views

I have a class Car, an enum Position, and a class Wheel. In Car, I have a map attribute: private Map<Position, Wheel> wheels; I want to represent this structure in a UML class diagram. My ...
Activa Suit's user avatar
  • 51
0 votes
1 answer
108 views

Given data and mask tensors are there a pytorch-way to obtain masked aggregations of data (mean, max, min, etc.)? x = torch.tensor([ [1, 2, -1, -1], [10, 20, 30, -1] ]) mask = torch.tensor([ ...
Sengiley's user avatar
  • 289
2 votes
2 answers
80 views

I am learning about UML-Class-Diagram and I have come across directional association. After long hours of research, I became insane because everyone is explaining it differently and there is only an ...
Ado's user avatar
  • 55
2 votes
2 answers
79 views

The data I am working with: data (140631115432592), ndim: 2, size: 3947910, shape: (232230, 17) VIN (1-10) object County ...
khteh's user avatar
  • 4,290
0 votes
1 answer
90 views

I have a dataframe which has the following columns: region_id, name, parent, parent_name, t2m, d2m, and tp. I want to group and aggregate column values in a specific way. To enable that, I have ...
TRK's user avatar
  • 205
-3 votes
1 answer
77 views

I have a dataset of usage data per account, with multiple usage metrics for four years represented monthly as 'Jan.21'. I need yearly aggregates in columns in pivot table. Columns: 'Account name', '...
ande's user avatar
  • 67
0 votes
0 answers
44 views

Problem: I have a MongoDB collection TrackingReport with 4 M+ records (expected to grow to billions) that stores user location tracking data. I need to get the latest tracking record for each user ...
Komol Chandra Devnath's user avatar
  • 29
0 votes
1 answer
72 views

In Kibana Watcher, I'm trying to use the average results from a nested aggregation of a bucket on a condition within a Kibana Watcher but getting an null reference error when running a simulate on the ...
John Harris's user avatar
  • 3
0 votes
0 answers
67 views

I'm hoping someone can point me in the right direction here or share some approaches to a challenging feature I need to implement in my Laravel 11 project. I have a model called StatisticAggregate ...
Ryan H's user avatar
  • 3,093
0 votes
0 answers
69 views

I have a table definition in Apache Druid with a column as a complex type COMPLEX<serializablePairLongString> created by an ingestion aggregation. So the column data is displayed like: column ...
groo's user avatar
  • 4,478
0 votes
1 answer
74 views

I recently upgraded Mudblazor version from 7.15.0 to 8.0.0-preview.6 and then in all components where Data grid was used, aggregation part was shifted.so I had to downgrade to previous version. A ...
siamak danesh's user avatar
  • 11
1 vote
1 answer
41 views

I have daily sales data for multiple products in three stores. It looks something like this: item_id store_id category_id dept_id date event_name daiy_price a tx_1 food 1 2012/12/24 6 a tx_1 food 1 ...
Tim George's user avatar
  • 13
1 vote
2 answers
59 views

CREATE TABLE EMPLOYEE ( empId INTEGER AUTO_INCREMENT PRIMARY KEY, name TEXT NOT NULL, dept TEXT NOT NULL ); INSERT INTO EMPLOYEE(name, dept) VALUES ('Clark', 'Sales'); INSERT INTO EMPLOYEE(name,...
kahn's user avatar
  • 55
-2 votes
1 answer
56 views

I have an aggregation use case where I have a large JSON containing product orders data that I need to aggregate. Below is a small subset of the data which I am planning to aggregate and seek your ...
neeraj's user avatar
  • 23
0 votes
1 answer
18 views

I have an Elasticsearch index that stores documents with the following fields: timestamp (date) priority (integer) user_id (string) I need to find 5 unique user_id values from the most recent and ...
pred1212's user avatar
  • 3
-1 votes
1 answer
84 views

How do I perform a “Compound/Must” across EnbeddedDocument and RootDocument fields? Ive create a playground for this issue im facing https://search-playground.mongodb.com/tools/code-playground/...
O'Neil Tomlinson's user avatar
  • 898
1 vote
0 answers
63 views

Setup Imagine this document shape: { dateString: "2024-10-31", // type string realDate: ISODate("2024-10-31"), // type date } Assume both fields are indexed separately. ...
Mark's user avatar
  • 1,091
0 votes
1 answer
85 views

I have the below document { "_id": "101", "PublisherName": "Big book publishers", "PublisherAddress": "123 Mian Street", &...
O'Neil Tomlinson's user avatar
  • 898
0 votes
1 answer
134 views

I have the following document in my collection { "_id": "101", "PublisherName": "Big book publishers", "Books": [ { &...
O'Neil Tomlinson's user avatar
  • 898
0 votes
0 answers
192 views

I'm having an issue with an Apache Camel route after migrating to version 4.6.0. The problem is that the exchange is never set to done when exchange-factory is pooled instead of default value ...
skanso's user avatar
  • 25
-1 votes
1 answer
77 views

Try to find the continents where all countries have a population <= 25000000 from the world table below as in Difficult Questions That Utilize Techniques Not Covered In Prior Sections. name ...
mon's user avatar
  • 23k
1 vote
2 answers
62 views

Hi have this data frame: Server 1-Jun 6-Jun 1-jul Jul-10 ServerA 8 9 5 90 ServerB 100 10 9 90 I need to create another column called maximumval and pick ...
user1471980's user avatar
  • 10.7k
0 votes
1 answer
549 views

Some context: I'm working on a React.js frontend app, using the AgGridReact component. I've managed to get various custom aggregations working, default aggs working, etc. In a typical scenario like ...
Vee's user avatar
  • 786
-3 votes
1 answer
90 views

So every day I have to pull a report that gets data for yesterday's metrics, forecasted Saturday's metrics, and Week to date sums. I want to write a Python code that automates the process. I have most ...
Kael_1993's user avatar
  • 15
0 votes
0 answers
86 views

I have a collection named sales with documents structured as follows:- { "_id": ObjectId("..."), "date": ISODate("2024-06-15T00:00:00Z"), "store": &...
JS Noob's user avatar
  • 1
0 votes
1 answer
322 views

I would like to do a Facet Search that returns the "$$SEARCH_META" based on the documentation (https://www.mongodb.com/docs/atlas/atlas-search/facet/). A snippet of the search definition ...
O'Neil Tomlinson's user avatar
  • 898
0 votes
1 answer
61 views

I use MongoDB version 7. I store the payments data with order and buyer information. I have a few payments in a collection with order and buyer information, which I group by order id to the next JSON ...
Vladimir Lykov's user avatar
  • 35
0 votes
0 answers
20 views

I have an application where I am using integration splitter to split messages and created list of messagges and send them out for processing. When response is received individually for aggregation ...
Tanu Arora's user avatar
  • 1
0 votes
0 answers
39 views

I'm using MongoDB v5 with NodeJS (no Mongoose). Let's say I have a collection structured the following way. This specific setup (an ObjectId nested inside an object contained inside an array contained ...
João Santos's user avatar
  • 109
1 vote
1 answer
35 views

We are currently developing a large data transfer process through mongodb and spring. I created a composite index using compass, but it is not actually used. It seems that the field name is in Url ...
배인환's user avatar
  • 11
-2 votes
1 answer
53 views

What Postgres query can I use for the below scenario? Parent table: Child table: Expected result Explanation: Parent1 --> 4 equipments. Parent1 has ... Child1 holding 3 equipment Child2 holding ...
user2413387's user avatar
  • 37
1 vote
1 answer
52 views

I need to aggregate some sub-tag values into a Oracle SQL column. Let's say the XML structure is something like this: <Product> [..other tags..] <Attributes> <Statements Id="1&...
Gol D Rosen's user avatar
  • 13
0 votes
0 answers
52 views

Data: I have MongoDB setup to hold information about different devices. Each device can contain multiple nodes which have parent-child relationship. Each device can be applicable to multiple platforms ...
Udhayha Karthik's user avatar
  • 115
0 votes
0 answers
64 views

I am able to execute mongo query on mongo compass with below aggregation but I am not able to execute and get same result on Spring boot application [ { $match: { $and: [ { ...
Serdar's user avatar
  • 432
2 votes
0 answers
172 views

I have the following problem with a complex aggregation in postgres (16). The datamodel (CREATE Statements and ER-diagram) and an example of the required result set are to be found under the question. ...
erchenstein's user avatar
  • 63
0 votes
0 answers
76 views

I encountered the following scenario: I’m doing an aggregation for the MasterCollection collection. I’m “joining” this collection with other 9 collections in the aggregation. In the end, I’m merging ...
Boros Gergo's user avatar
  • 1
0 votes
1 answer
35 views

I have a simple MongoDB array of objects with this structure: [ { "_id": { "$oid": "6688c2f6b79f2bfefb751d5f" }, "date": "06/07/2024&...
vgeorg's user avatar
  • 3

1
2 3 4 5
…
70