Skip to main content
9,302 questions
Newest Active Bountied Unanswered
Filter by
Sorted by
Tagged with
0 votes
1 answer
77 views

I want to apply a quantization function to a deep CNN. This CNN is used for an image classification(in 4 classes) task, and my data consists of 224×224 images. When I run this code, I get an error. ...
jasmine's user avatar
  • 31
4 votes
1 answer
165 views

I've been working on implementing some compression algorithms in C/C++ and JavaScript, I've started by building out LZSS. So far everything seems good. I check my dictionary buffer for matches, and if ...
Mornig Star's user avatar
  • 113
1 vote
0 answers
40 views

I‘m using an Azure Data Factory with an ODATA source from an external system. While everything works fine, I noticed the slow performance. So I checked this with postman and spotted immediately, that ...
Jörg's user avatar
  • 71
Tooling
0 votes
1 replies
43 views

I have been following the inner working of Deflate compression and I have came across a junction in which I need to understand how efficient are compressor's choices with this lossless compression ...
actgroup inc's user avatar
  • 27
0 votes
2 answers
155 views

I'm building a Huffman compressor in Java. I already have: The original text, the Huffman code table (Map<Character, String>), and the order of character appearance. My current goal is to write ...
Eslyn19's user avatar
  • 19
0 votes
0 answers
51 views

I have an application which keeps appending data for a wide range of sessionIDs and expiring them in a few hours, currently we use Redis List data structure and having the SessionID as the key. For ...
zhouton zhouton's user avatar
  • 1
4 votes
2 answers
143 views

I have a table with a column of type VARCHAR(MAX) with COLLATE Latin1_General_100_CI_AS_SC_UTF8 in a SQL Server database. I want to compress the values in the column with built-in COMPRESS() function. ...
Oleksandr's user avatar
  • 355
-3 votes
1 answer
60 views

I wrote a dissector. I need to decompress zlib format package when analyzing data. such as: content_bytes = zlib.decompress(content_bytes) I have tried: local zlib = require("zlib") -- got ...
xietao's user avatar
  • 11
4 votes
3 answers
200 views

I want to serialize R objects as JSON for other programs to use, and gzip them for efficient transport. So I run data <- list(foo = "bar") readr::write_file(jsonlite::as_gzjson_b64(data), ...
Raphael's user avatar
  • 10.8k
3 votes
1 answer
173 views

Plese guide me, what I am doing wrong. I am not able to coming up with working solution. I am trying to inflate PDF - deflate stream with Zlib. The below code written by me. int main(){ char* ...
Susobhan Das's user avatar
  • 1,310
1 vote
1 answer
81 views

I'm trying to serialize and compress a std::map using Boost. Here's the serialization code: #include <boost/archive/binary_oarchive.hpp> #include <boost/iostreams/filtering_stream.hpp> #...
Setu's user avatar
  • 1,086
0 votes
2 answers
124 views

Is there any way to decompress csv lz4 files by Spark? I tried following approaches: First: sparkSession.read .option("delimiter", ",") .option("compression", "...
Jelly's user avatar
  • 1,434
0 votes
1 answer
273 views

I generated a hdf5 file with the code below: # Create forecast training data file import h5py import hdf5plugin #mmap_array = np.memmap('video_prediction_224.dat', dtype='uint8', mode='w+', shape=(...
Aiden Yun's user avatar
  • 63
0 votes
0 answers
54 views

How to extract the first n rows of a block compressed tab-separated value text file (.tsv.bgz), which could only be accessed with gsutil, into a text file? The original file is very large, so I wonder ...
Xunzhi Zhang's user avatar
  • 1
0 votes
1 answer
78 views

I understand that dictionary compression is shipped with Chrome 130 and later. I am trying to get the demo at https://compression-dictionary-transport-threejs-demo.glitch.me/ to work, but for some ...
sanjith kumar's user avatar
  • 355
7 votes
1 answer
157 views

Note the following gzip compressions: $ seq 1000000 > file.txt $ ls -l total 6728 -rw-r--r--. 1 felix felix 6888896 jun 6 18:29 file.txt $ gzip -f -k file.txt $ ls -l total 8808 -rw-r--r--. 1 ...
Felix's user avatar
  • 101
0 votes
1 answer
68 views

I'm trying to create a Cassandra table from Java code using Datastax's SchemaBuilder class. I'm essentially trying to convert this CQL query: CREATE TABLE <tablename> (id text, key blob, val ...
scottstots's user avatar
  • 344
0 votes
2 answers
144 views

I am searching for a text compression algorithm that fulfills the following criteria: must allow to append/add new text to existing compressed text without decompression allow searching within the ...
jeha's user avatar
  • 69
1 vote
0 answers
131 views

I'm trying to accomplish the following: Open a TIF image file (which contains an alpha channel and Geo Location data) remove the Alpha channel Save a compressed version of the TIF file using JPEG ...
ddetding's user avatar
  • 61
0 votes
0 answers
43 views

I’ve been working on compressing tick data and have made some progress, but I’m looking for ways to further optimize file sizes. Currently, I use delta encoding followed by saving the data in Parquet ...
lazarea's user avatar
  • 1,369
0 votes
1 answer
40 views

I'm currently working on a nodeJS implementation(I'm new with node). Basically I have created an API Gateway with a Lambda Function(GET REST service) to query all the records for a postgreSQL table. ...
Allanh's user avatar
  • 545
0 votes
1 answer
84 views

I'm working on implementing a differential update mechanism in .NET. The idea is to split data into 64 KB blocks and compress each block independently using SharpZipLib in raw mode (i.e., without the ...
SuperJMN's user avatar
  • 14.1k
0 votes
1 answer
100 views

I'm trying to understand the relationship between the blocks defined in the AppxBlockMap.xml file of an MSIX package and the compression process, specifically the Deflate algorithm used in ZIP-based ...
SuperJMN's user avatar
  • 14.1k
1 vote
1 answer
343 views

I'm currently working on a Nuxt 3 project with the following configuration: export default defineNuxtConfig({ srcDir: "src/", devtools: { enabled: true }, ssr: true, modules: [ ... ]...
kevin castañeda's user avatar
  • 15
0 votes
0 answers
49 views

I am using flutter_quick_vide_encoder Flutter package to create a video from images. The package documentation explains, and there is also an example, on how to create a video with PCM audio generated ...
Aurumque's user avatar
  • 439
0 votes
1 answer
41 views

Aside from the image not being properly represented in something like an image editor, if my goal is to simply compress the pixels, and then retrieve them by decoding and reading them as I wrote them, ...
Zebrafish's user avatar
  • 16.5k
0 votes
1 answer
51 views

When I used Image.resolveAssetSource, I was getting a null value when using an image URL instead of a local image. When I used onLoad, I received {"height": 972, "width": 1296}, ...
Ben J's user avatar
  • 1
0 votes
1 answer
39 views

Background for purpose sparse/compressible data structure/compressible honeycumbs, vague description to give you an idea: This would allow an array of [0..255] connection points hopefully. If all of ...
oOo's user avatar
  • 301
0 votes
1 answer
100 views

I'm trying to make a simple transparent filesystem in fuse. I'm using this guide as a basis. This code works perfectly. I'm trying to modify it so that it compresses and then encrypts as well. So far ...
lee's user avatar
  • 782
1 vote
0 answers
94 views

I am playing around with compressing on Node.js server. While my streaming implementation of brotli-compression is working just fine, I can't get compression to work using brotliCompressSync method. I ...
re-gor's user avatar
  • 1,351
2 votes
0 answers
93 views

The Re-Pair algorithm performs text compression by recursively replacing the most frequent pair of characters occurring in the text. The algorithm gets very slow on large texts, I was wondering how ...
monblu's user avatar
  • 547
0 votes
2 answers
212 views

I have a shell script that processes compressed (gzipped) .avro files stored in GCS and loads them into BigQuery. Here's the current small setup: process_file.sh: #!/bin/bash set -e PROJECT_ID="...
Spine Feast's user avatar
  • 143
0 votes
0 answers
990 views

My project has been using zlib for its decompression methods for a long time. Suddenly while trying to update packages its throwing a TypeError in the following code: Argument of type 'Buffer' is not ...
Calladrus2k1's user avatar
  • 104
0 votes
0 answers
32 views

I’m exploring the possibility of adding data compression functionality to the VcXsrv X Server to optimize X11 communication over the network. Specifically, I want to compress X11 data before ...
Minh Trần's user avatar
  • 74
0 votes
1 answer
105 views

I'm importing images from a security camera for image processing. After importing the image, I want to save the image for archiving (processing will happen on the fly). I see two available methods for ...
Oaknut's user avatar
  • 13
1 vote
0 answers
271 views

I'm at a loss. I am on .NET Framework 4.8. I installed K4os.Compression.LZ4 1.3.8 via Nuget and use LZ4Pickler.Pickle(). My required dependencies according to https://www.nuget.org/packages/K4os....
Powerslave's user avatar
  • 477
1 vote
0 answers
53 views

I’m trying to implement an MP3-like compression algorithm for audio and have followed the general steps, but I’m encountering a few issues with the quantization step. Here's the overall process I'm ...
Muchacho's user avatar
  • 17
2 votes
1 answer
222 views

I want to compress several hundred images together into a single file. The images are all scans of Magic: The Gathering cards, which means they have large blocks of similar color and share many ...
Isaac King's user avatar
  • 394
0 votes
0 answers
58 views

I have a PySpark DataFrame result after preprocessing and ETL. I can calculate the current size of DataFrame using the following syntax: size_estimator = spark._jvm.org.apache.spark.util.SizeEstimator ...
cisco306's user avatar
  • 28
1 vote
1 answer
136 views

I want to create an ORC file compressed with ZLIB compression level 9. Thing is, when using pyarrow.orc, I can only choose between "Speed" and "Compression" mode, and can't control ...
Y.S's user avatar
  • 1,862
2 votes
0 answers
55 views

In an embedded system where RAM is at premium, I need to decompress a LZString-compressed piece of data of roughly 1kByte max, producing less than 2kByte of (ASCII JSON) characters when decompressed. ...
fgrieu's user avatar
  • 2,962
0 votes
1 answer
171 views

This is my program to compress data (it is free but has copyright for commercial usage) . This program suppose to read a file as data-number and find a huge nth root of file (depending on file size) ...
HadiLovelorn's user avatar
  • 51
1 vote
1 answer
764 views

I am using ASP.NET Core 6.0. I have an API which returns compressed data. Simplified version of my code looks like this: [HttpPost("[action]", Name = "GetData")] public ...
Creative Learner's user avatar
  • 23
0 votes
1 answer
67 views

I'm trying to decompress and recompress a specific piece of compressed data in Python to reproduce the original compressed output. However, I can't achieve a match with zlib, and I'm unsure what ...
neatsof's user avatar
  • 11
0 votes
1 answer
180 views

My goal is to write a png image from a starting bitmap image. I know the existence of many libraries, but I need to write it from scratch. The first function I have implemented is "...
Jonny_92's user avatar
  • 155
1 vote
0 answers
85 views

I am trying to use MINIZ library in my embedded device, and am almost done with success except for an issue in decompressing, similar to the one reported here: Wrap buffer in minizs tinfl_decompress ...
dario's user avatar
  • 11
0 votes
1 answer
276 views

I have compressed files in blob storage and I'm trying to unzip them with an Azure Data Factory activity. Each compressed file is composed of compressed folders inside. So when I try to unzip, it has ...
Akcil's user avatar
  • 73
1 vote
1 answer
314 views

I want to to decompress raw data from a file in an exotic format, but I know that the compression method is the same that is used in a ZIP file (PKZIP). In the file the PK\03\04 signature is missing. ...
PanJanek's user avatar
  • 6,717
1 vote
2 answers
190 views

Question While studying encoding theory, I encountered a set of code tables where I need to determine whether they belong to one of the following categories: A:Prefix codes B:Huffman codes C:Optimal ...
459zyt's user avatar
  • 115
0 votes
0 answers
81 views

Running the risk of this being a stupid question, I ran into a strange mystery with TIFF image files that I hope that some compression guru can explain. The mystery is this: Two seemingly in all ...
Zimeon's user avatar
  • 29

1
2 3 4 5
…
187