CUDA_VISIBLE_DEVICES=4,5,6,7 python examples/offline_inference/glm4_5v.py --num_prompts 3 --model glm45-fp8 --mm

Adding requests: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:05<00:00,  1.80s/it]
Processed prompts: 100%|█████████████████████████████████████████████████████████████████| 3/3 [00:01<00:00,  1.60it/s, est. speed input: 9574.60 toks/s, output: 10.14 toks/s]
Generated text: ', '
Generated text: ', , the., the '
Generated text: ',  connected by, '

Adding requests: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:04<00:00,  1.62s/it]
Processed prompts: 100%|█████████████████████████████████████████████████████████████████| 3/3 [00:14<00:00,  4.83s/it, est. speed input: 1239.39 toks/s, output: 50.00 toks/s]
Generated text: "<think>The user is asking to describe the content of the image. First, I need to look at the image provided. The image shows a duck swimming in water. Let me observe the details: the duck has a green head, a yellow beak, and its body is a mix of brown, white, and black. The water is blue with ripples, and there's a reflection of the duck in the water. I should describe the duck's appearance, its position in the water, and the surrounding environment. Make sure to mention the colors and any notable features like the reflection. Also, check if there are any other elements, but it seems the main focus is the duck. So the content is a duck swimming in water with its reflection visible.</think>\nThe image shows a duck swimming in a body of water. The duck has a green iridescent head, a bright yellow beak, and a body with brown, white, and black feathers. The water is a deep blue with gentle ripples, and the duck's reflection is visible on the surface. The overall scene depicts a calm aquatic environment with the duck as the central subject.\nThe answer is <|begin_of_box|>A duck swimming in water with its reflection visible.<|end_of_box|>"
Generated text: "<think>The user is asking to describe the content of the image. First, I need to look at the image carefully. The image shows a lion in a grassy field. The lion has a prominent mane, which is a mix of brown and darker colors. The background is a field of tall, dry grass with some green patches, indicating a savanna or grassland environment. The lion is sitting or standing in the grass, looking directly at the camera with a calm expression. I should describe the lion's features, the environment, and any other notable details. Make sure to mention the mane, the grass, and the overall setting. Also, check if there are any other elements, but it seems the main focus is the lion in the grassland.</think>\nThe image depicts a majestic lion with a thick, dark brown and black mane, sitting in a field of tall, dry grass. The lion is facing the camera, with a calm and alert expression. The background consists of a vast expanse of golden-brown grass, with some green patches, suggesting a savanna or grassland habitat. The lighting appears natural, likely from sunlight, highlighting the lion's features and the texture of the grass."
Generated text: "<think>The user is asking to describe the content of the image. First, I need to look at the image carefully. The image shows a bird perched on a tree branch. The bird has a blue head and back, with a white underpart. It's holding something in its beak, which looks like a nest material or maybe an insect. The background is blurred, showing green foliage and tree trunks, indicating a natural outdoor setting. I should describe the bird's appearance, its position, and the surroundings. Make sure to mention the colors, the object in its beak, and the environment.</think>\nThe image shows a bird perched on a tree branch. The bird has a blue head, back, and wings, with a white underbelly and a white patch on its neck. It is holding a bundle of what appears to be nesting material or an insect in its beak. The background is blurred, featuring green foliage and tree trunks, suggesting a natural, outdoor environment. The bird's claws are gripping the branch, and its posture indicates it might be preparing to build a nest or has just caught prey."

python examples/offline_inference/glm4_5v.py --num_prompts 3 --model glm45

Generated text: ' John and I am a 20 year old college student. I am currently studying to be a teacher and I am looking for a part time job to help pay for my college expenses. I have experience with children of all ages and I am very responsible. I am available to work any time and I am willing to travel. I am looking forward to hearing from you. Thank you. John. 610-639-8350.'
Generated text: " the head of state and head of government of the United States. The president leads the executive branch of the federal government and is the commander-in-chief of the United States Armed Forces.\nThe president is indirectly elected to a four-year term by an Electoral College (or by Congress if no candidate receives a majority of the vote in the Electoral College). Since 1937, with some exceptions, presidents have been inaugurated on January 20. On this date, following the oath of office, the president delivers the inaugural address, which sets the tone for the president's term. Since the 1950s, the president's annual address to Congress on the state of the union has often been referred to as the State of the Union address. Although the president may fulfill this requirement in any way he or she sees fit, since 1965, all presidents have delivered the speech in person before a joint session of Congress.\nSince the office was established in 1789, 44 men have served as president. The first president, George Washington, who won a unanimous vote in the Electoral College, set many precedents that would be followed in future administrations. Among these are limiting the president to two terms in office and the existence of a cabinet to advise the president on matters of policy"
Generated text: ' Paris. It is one of the most beautiful cities in the world. It is known as the City of Light. The population of Paris is about 10 million people. Paris is situated on the river Seine. It is the centre of the national economy and culture and is very beautiful. There are a lot of places of interest in Paris. Among them are: the Notre Dame cathedral, the Louvre with the famous painting the Mona Lisa by Leonardo da Vinci, the Alexandre III bridge, the Champs Elysees, the Arch of Triumph, the Eiffel Tower and others. Paris is famous for its beautiful trees and flowers too. Paris is an international centre for fashion, music, theatre, and the visual arts. There are many big stores, hotels and restaurants in Paris. Paris is a very old city. It is more than 20 centuries old. Paris has greatly contributed to education of mankind. It is still one of the world’s main centres for education and intellectual life. There are a lot of museums, art galleries, theatres, educational and scientific centres in Paris. The most well-known educational centre in Paris is the Sorbonne. Many great men of the world studied at the Sorbonne. Paris is called the City of Light not only because'

CUDA_VISIBLE_DEVICES=4,5,6,7 python examples/offline_inference/glm4_5v.py --num_prompts 3 --model glm45-fp8

Generated text: ' David and I am a 20 year old college student. I am currently studying to be a teacher. I am a very outgoing person and I am always up for a good time. I am looking for someone who is also outgoing and is not afraid to have a good time. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous. I am looking for someone who is not afraid to be themselves and is not afraid to be spontaneous.'
Generated text: ' the head of state and head of government of the United States. The president is also the commander-in-chief of the United States armed forces. The president is a symbol of the United States.\nThe president is elected to a four-year term by the people. Since 1951, no person can be elected president more than twice. The president must be at least 35 years old and a natural-born citizen of the United States. The president must have lived in the United States for at least 14 years.\nThe president is assisted by the vice president. The vice president is also elected to a four-year term. The vice president is the president of the Senate. The vice president can vote in the Senate if there is a tie.\nThe president has many powers. The president can make treaties with other countries. The president can appoint judges to the Supreme Court. The president can veto laws passed by Congress. The president can pardon people who have been convicted of crimes.\nThe president is the most powerful person in the United States. The president is the leader of the country and the head of the government.\nThe president of the United States is the head of state and head of government of the United States. The president is also the commander-in-chief of the United States armed forces. The'
Generated text: ' Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital of France is Paris. The capital