Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementation of BackboneImbalanceScenario #1476

Closed

Conversation

garyparrot
Copy link
Collaborator

@garyparrot garyparrot commented Feb 4, 2023

這個 PR 實作一個 Scenario 他可以建立 #1424 的情境。

Scenario 現在會回傳一個物件,內容包含他的生成情境的一些描述和統計資訊。這個 PR 完成後,會再另外開一個 PR,給 WebService 新增一個 ScenarioHandler,他可以透過 Web API 的形式來對叢集套用特定的情境。然後將 Scenario 回傳的資訊以 JSON 回覆給使用者。

回覆的資訊包含:

  • 節點的網路輸入
  • 節點的網路輸出
  • 平均 topic consumer fanout
  • Performance Tool 的指令
  • 每個 topic 的 consumer fanout
  • 每個 topic 的 data rate
  • topic 的 data rate 統計成的直方圖
  • 總叢集承受的 consume data rate
  • 總叢集承受的 produce data rate
  • 總叢集 partiiton 數量
  • 總叢集 topic 數量

詳細回傳如下:

CLICK ME

{
  "brokerEgress": {
    "0": "535.10 MB/seconds",
    "1": "523.16 MB/seconds",
    "2": "1.03 GB/seconds",
    "3": "541.52 MB/seconds",
    "4": "504.48 MB/seconds",
    "5": "507.36 MB/seconds"
  },
  "brokerIngress": {
    "0": "494.61 MB/seconds",
    "1": "496.46 MB/seconds",
    "2": "1.00 GB/seconds",
    "3": "502.34 MB/seconds",
    "4": "486.16 MB/seconds",
    "5": "486.10 MB/seconds"
  },
  "consumerFanoutAverage": 1,
  "perfCommands": [
    {
      "args": "--topics topic_528,topic_927,topic_804,topic_409,topic_366,topic_641,topic_364,topic_881,topic_127,topic_248,topic_887,topic_126,topic_764,topic_522,topic_490,topic_252,topic_71,topic_76,topic_879,topic_913,topic_515,topic_639,topic_750,topic_233,topic_871,topic_630,topic_198,topic_595,topic_870,topic_116,topic_512,topic_876,topic_634,topic_995,topic_236,topic_874,topic_241,topic_480,topic_919,topic_6,topic_65,topic_549,topic_824,topic_946,topic_704,topic_429,topic_825,topic_305,topic_943,topic_669,topic_781,topic_540,topic_787,topic_666,topic_304,topic_942,topic_268,topic_664,topic_148,topic_391,topic_273,topic_791,topic_395,topic_150,topic_52,topic_417,topic_46,topic_812,topic_818,topic_936,topic_530,topic_651,topic_773,topic_498,topic_495,topic_253,topic_375,topic_931,topic_774,topic_532,topic_137,topic_258,topic_262,topic_383,topic_780,topic_140,topic_726,topic_206,topic_602,topic_328,topic_848,topic_288,topic_561,topic_562,topic_683,topic_446,topic_204,topic_600,topic_689,topic_843,topic_169,topic_324,topic_445,topic_171,topic_290,topic_174,topic_571,topic_293,topic_319,topic_836,topic_437,topic_713,topic_959,topic_278,topic_793,topic_397,topic_556,topic_952,topic_435,topic_678,topic_796,topic_158,topic_313,topic_680,topic_285,topic_164,topic_161,topic_21,topic_748,topic_869,topic_228,topic_624,topic_13,topic_504,topic_867,topic_628,topic_904,topic_18,topic_222,topic_982,topic_341,topic_100,topic_743,topic_501,topic_226,topic_348,topic_587,topic_741,topic_466,topic_862,topic_983,topic_863,topic_190,topic_351,topic_907,topic_95,topic_736,topic_88,topic_219,topic_615,topic_858,topic_977,topic_739,topic_618,topic_850,topic_451,topic_452,topic_455,topic_456,topic_581,topic_186,topic_87 --throttle topic_528-0:211993Byte/second,topic_528-1:557429Byte/second,topic_528-2:509815Byte/second,topic_528-3:726966Byte/second,topic_528-4:59155Byte/second,topic_528-5:591654Byte/second,topic_927-0:132141Byte/second,topic_927-1:106657Byte/second,topic_927-2:78738Byte/second,topic_927-3:363299Byte/second,topic_927-4:240320Byte/second,topic_927-5:243224Byte/second,topic_927-6:325646Byte/second,topic_804-0:454732Byte/second,topic_804-1:498303Byte/second,topic_804-2:32398Byte/second,topic_804-3:181627Byte/second,topic_804-4:490678Byte/second,topic_804-5:312826Byte/second,topic_804-6:167089Byte/second,topic_804-7:109307Byte/second,topic_409-0:38829Byte/second,topic_409-1:946522Byte/second,topic_409-2:926910Byte/second,topic_409-3:658937Byte/second,topic_409-4:86168Byte/second,topic_409-5:664454Byte/second,topic_366-0:84088Byte/second,topic_366-1:55603Byte/second,topic_366-2:188656Byte/second,topic_366-3:112423Byte/second,topic_366-4:242167Byte/second,topic_641-0:428857Byte/second,topic_641-1:402110Byte/second,topic_641-2:418841Byte/second,topic_641-3:421123Byte/second,topic_641-4:50177Byte/second,topic_641-5:199204Byte/second,topic_641-6:191346Byte/second,topic_641-7:80378Byte/second,topic_364-0:578624Byte/second,topic_364-1:536308Byte/second,topic_364-2:728271Byte/second,topic_364-3:275714Byte/second,topic_364-4:150689Byte/second,topic_881-0:94196Byte/second,topic_881-1:138591Byte/second,topic_881-2:30133Byte/second,topic_881-3:181619Byte/second,topic_881-4:88390Byte/second,topic_881-5:82785Byte/second,topic_881-6:138198Byte/second,topic_881-7:31353Byte/second,topic_881-8:144354Byte/second,topic_881-9:27491Byte/second,topic_881-10:85787Byte/second,topic_881-11:173701Byte/second,topic_881-12:11704Byte/second,topic_881-13:23233Byte/second,topic_881-14:82775Byte/second,topic_127-0:50421Byte/second,topic_127-1:427796Byte/second,topic_127-2:98081Byte/second,topic_127-3:81355Byte/second,topic_127-4:176574Byte/second,topic_127-5:282549Byte/second,topic_127-6:70928Byte/second,topic_127-7:10453Byte/second,topic_127-8:48666Byte/second,topic_248-0:447569Byte/second,topic_248-1:667618Byte/second,topic_248-2:140281Byte/second,topic_248-3:455525Byte/second,topic_248-4:621307Byte/second,topic_887-0:217684Byte/second,topic_887-1:776723Byte/second,topic_887-2:193469Byte/second,topic_887-3:632350Byte/second,topic_887-4:443339Byte/second,topic_887-5:120336Byte/second,topic_126-0:698037Byte/second,topic_126-1:495009Byte/second,topic_126-2:859774Byte/second,topic_126-3:24019Byte/second,topic_126-4:1115743Byte/second,topic_764-0:64193Byte/second,topic_764-1:138759Byte/second,topic_764-2:746404Byte/second,topic_764-3:557607Byte/second,topic_764-4:742077Byte/second,topic_764-5:120203Byte/second,topic_764-6:324036Byte/second,topic_764-7:698563Byte/second,topic_522-0:199393Byte/second,topic_522-1:96099Byte/second,topic_522-2:289760Byte/second,topic_522-3:2998Byte/second,topic_522-4:47405Byte/second,topic_522-5:180234Byte/second,topic_522-6:187842Byte/second,topic_522-7:119530Byte/second,topic_522-8:257015Byte/second,topic_522-9:118631Byte/second,topic_522-10:150033Byte/second,topic_522-11:82382Byte/second,topic_522-12:217647Byte/second,topic_522-13:59542Byte/second,topic_490-0:432495Byte/second,topic_490-1:371091Byte/second,topic_490-2:334090Byte/second,topic_490-3:501079Byte/second,topic_490-4:539487Byte/second,topic_490-5:442671Byte/second,topic_490-6:482609Byte/second,topic_490-7:198281Byte/second,topic_490-8:226547Byte/second,topic_490-9:426008Byte/second,topic_252-0:34637Byte/second,topic_252-1:104619Byte/second,topic_252-2:74038Byte/second,topic_252-3:111352Byte/second,topic_252-4:70240Byte/second,topic_252-5:25673Byte/second,topic_252-6:93096Byte/second,topic_252-7:49304Byte/second,topic_252-8:139328Byte/second,topic_71-0:634850Byte/second,topic_71-1:619374Byte/second,topic_71-2:412077Byte/second,topic_71-3:31698Byte/second,topic_71-4:409400Byte/second,topic_76-0:188349Byte/second,topic_76-1:389516Byte/second,topic_76-2:135067Byte/second,topic_76-3:286846Byte/second,topic_76-4:515321Byte/second,topic_879-0:54890Byte/second,topic_879-1:137692Byte/second,topic_879-2:114724Byte/second,topic_879-3:117836Byte/second,topic_879-4:147352Byte/second,topic_879-5:150524Byte/second,topic_913-0:671603Byte/second,topic_913-1:197680Byte/second,topic_913-2:130990Byte/second,topic_913-3:284240Byte/second,topic_913-4:377220Byte/second,topic_913-5:105230Byte/second,topic_913-6:391331Byte/second,topic_913-7:268175Byte/second,topic_515-0:93851Byte/second,topic_515-1:146831Byte/second,topic_515-2:412453Byte/second,topic_515-3:184772Byte/second,topic_515-4:206641Byte/second,topic_515-5:286629Byte/second,topic_515-6:231922Byte/second,topic_515-7:160695Byte/second,topic_515-8:40339Byte/second,topic_515-9:219041Byte/second,topic_515-10:2288Byte/second,topic_515-11:369430Byte/second,topic_515-12:45115Byte/second,topic_639-0:203793Byte/second,topic_639-1:8018Byte/second,topic_639-2:163028Byte/second,topic_639-3:177515Byte/second,topic_639-4:252294Byte/second,topic_639-5:193562Byte/second,topic_639-6:132096Byte/second,topic_639-7:44261Byte/second,topic_639-8:176928Byte/second,topic_639-9:75522Byte/second,topic_639-10:241239Byte/second,topic_639-11:113612Byte/second,topic_639-12:240055Byte/second,topic_750-0:79244Byte/second,topic_750-1:104486Byte/second,topic_750-2:94208Byte/second,topic_750-3:3643Byte/second,topic_750-4:72457Byte/second,topic_750-5:3779Byte/second,topic_750-6:99116Byte/second,topic_750-7:99201Byte/second,topic_750-8:91752Byte/second,topic_750-9:82835Byte/second,topic_750-10:77633Byte/second,topic_750-11:74740Byte/second,topic_750-12:69996Byte/second,topic_750-13:89124Byte/second,topic_233-0:153247Byte/second,topic_233-1:143808Byte/second,topic_233-2:146866Byte/second,topic_233-3:111375Byte/second,topic_233-4:170523Byte/second,topic_233-5:61599Byte/second,topic_871-0:44934Byte/second,topic_871-1:150124Byte/second,topic_871-2:84960Byte/second,topic_871-3:58152Byte/second,topic_871-4:65385Byte/second,topic_871-5:135529Byte/second,topic_871-6:37251Byte/second,topic_871-7:61048Byte/second,topic_871-8:15097Byte/second,topic_871-9:116796Byte/second,topic_871-10:109928Byte/second,topic_630-0:198092Byte/second,topic_630-1:5914Byte/second,topic_630-2:132902Byte/second,topic_630-3:212808Byte/second,topic_630-4:237095Byte/second,topic_198-0:107125Byte/second,topic_198-1:353922Byte/second,topic_198-2:84716Byte/second,topic_198-3:200831Byte/second,topic_198-4:169574Byte/second,topic_198-5:141693Byte/second,topic_198-6:189166Byte/second,topic_198-7:269804Byte/second,topic_198-8:68729Byte/second,topic_198-9:343431Byte/second,topic_198-10:39124Byte/second,topic_198-11:124037Byte/second,topic_595-0:351620Byte/second,topic_595-1:276241Byte/second,topic_595-2:327698Byte/second,topic_595-3:461096Byte/second,topic_595-4:507287Byte/second,topic_595-5:238372Byte/second,topic_595-6:34787Byte/second,topic_870-0:127093Byte/second,topic_870-1:202520Byte/second,topic_870-2:291197Byte/second,topic_870-3:159561Byte/second,topic_870-4:406255Byte/second,topic_116-0:82080Byte/second,topic_116-1:183007Byte/second,topic_116-2:122291Byte/second,topic_116-3:122410Byte/second,topic_116-4:210683Byte/second,topic_116-5:53252Byte/second,topic_512-0:403014Byte/second,topic_512-1:403056Byte/second,topic_512-2:195143Byte/second,topic_512-3:191046Byte/second,topic_512-4:406323Byte/second,topic_512-5:457878Byte/second,topic_512-6:21549Byte/second,topic_512-7:61117Byte/second,topic_512-8:401286Byte/second,topic_512-9:145332Byte/second,topic_512-10:35398Byte/second,topic_876-0:35752Byte/second,topic_876-1:20185Byte/second,topic_876-2:135669Byte/second,topic_876-3:190869Byte/second,topic_876-4:72322Byte/second,topic_876-5:21414Byte/second,topic_876-6:184812Byte/second,topic_876-7:171439Byte/second,topic_876-8:345296Byte/second,topic_634-0:193271Byte/second,topic_634-1:121469Byte/second,topic_634-2:95413Byte/second,topic_634-3:194303Byte/second,topic_634-4:11873Byte/second,topic_634-5:126174Byte/second,topic_634-6:790Byte/second,topic_634-7:1833Byte/second,topic_634-8:204167Byte/second,topic_995-0:914395Byte/second,topic_995-1:1098515Byte/second,topic_995-2:848073Byte/second,topic_995-3:823483Byte/second,topic_995-4:419866Byte/second,topic_995-5:949298Byte/second,topic_995-6:522013Byte/second,topic_236-0:208247Byte/second,topic_236-1:40182Byte/second,topic_236-2:14990Byte/second,topic_236-3:56126Byte/second,topic_236-4:155123Byte/second,topic_236-5:267748Byte/second,topic_236-6:369630Byte/second,topic_236-7:166120Byte/second,topic_236-8:201858Byte/second,topic_236-9:11693Byte/second,topic_236-10:80396Byte/second,topic_236-11:21681Byte/second,topic_236-12:158485Byte/second,topic_874-0:31766Byte/second,topic_874-1:68184Byte/second,topic_874-2:7634Byte/second,topic_874-3:84008Byte/second,topic_874-4:75878Byte/second,topic_874-5:72596Byte/second,topic_874-6:52502Byte/second,topic_874-7:25640Byte/second,topic_874-8:58170Byte/second,topic_874-9:81029Byte/second,topic_874-10:38949Byte/second,topic_874-11:89403Byte/second,topic_241-0:370331Byte/second,topic_241-1:353183Byte/second,topic_241-2:191247Byte/second,topic_241-3:1037395Byte/second,topic_241-4:524036Byte/second,topic_480-0:556519Byte/second,topic_480-1:103530Byte/second,topic_480-2:422088Byte/second,topic_480-3:174731Byte/second,topic_480-4:553348Byte/second,topic_480-5:46165Byte/second,topic_480-6:169107Byte/second,topic_919-0:174774Byte/second,topic_919-1:215041Byte/second,topic_919-2:166687Byte/second,topic_919-3:13117Byte/second,topic_919-4:22721Byte/second,topic_919-5:281401Byte/second,topic_919-6:240526Byte/second,topic_919-7:251Byte/second,topic_919-8:26291Byte/second,topic_919-9:224129Byte/second,topic_919-10:276270Byte/second,topic_919-11:62144Byte/second,topic_919-12:16899Byte/second,topic_919-13:141540Byte/second,topic_919-14:179692Byte/second,topic_6-0:2005260Byte/second,topic_6-1:1701946Byte/second,topic_6-2:3390503Byte/second,topic_6-3:370760Byte/second,topic_6-4:3387571Byte/second,topic_6-5:322215Byte/second,topic_6-6:478200Byte/second,topic_65-0:113064Byte/second,topic_65-1:131049Byte/second,topic_65-2:66199Byte/second,topic_65-3:92943Byte/second,topic_65-4:126686Byte/second,topic_65-5:94527Byte/second,topic_65-6:111389Byte/second,topic_65-7:120418Byte/second,topic_65-8:31224Byte/second,topic_65-9:10163Byte/second,topic_65-10:76921Byte/second,topic_65-11:60831Byte/second,topic_65-12:6871Byte/second,topic_549-0:8830Byte/second,topic_549-1:725434Byte/second,topic_549-2:741035Byte/second,topic_549-3:641360Byte/second,topic_549-4:751583Byte/second,topic_549-5:250738Byte/second,topic_824-0:54831Byte/second,topic_824-1:568125Byte/second,topic_824-2:489365Byte/second,topic_824-3:41134Byte/second,topic_824-4:256803Byte/second,topic_946-0:297899Byte/second,topic_946-1:89593Byte/second,topic_946-2:67680Byte/second,topic_946-3:99366Byte/second,topic_946-4:11423Byte/second,topic_946-5:22440Byte/second,topic_946-6:317374Byte/second,topic_946-7:150539Byte/second,topic_946-8:146685Byte/second,topic_704-0:187043Byte/second,topic_704-1:393892Byte/second,topic_704-2:486414Byte/second,topic_704-3:252374Byte/second,topic_704-4:636176Byte/second,topic_704-5:420252Byte/second,topic_704-6:470338Byte/second,topic_704-7:163377Byte/second,topic_704-8:115382Byte/second,topic_429-0:244034Byte/second,topic_429-1:280491Byte/second,topic_429-2:154851Byte/second,topic_429-3:254921Byte/second,topic_429-4:200676Byte/second,topic_429-5:214043Byte/second,topic_429-6:462349Byte/second,topic_429-7:343290Byte/second,topic_825-0:165964Byte/second,topic_825-1:363819Byte/second,topic_825-2:46186Byte/second,topic_825-3:287461Byte/second,topic_825-4:76003Byte/second,topic_825-5:74262Byte/second,topic_825-6:30755Byte/second,topic_825-7:306487Byte/second,topic_825-8:316975Byte/second,topic_825-9:105238Byte/second,topic_825-10:281957Byte/second,topic_305-0:226133Byte/second,topic_305-1:157555Byte/second,topic_305-2:291102Byte/second,topic_305-3:244774Byte/second,topic_305-4:617243Byte/second,topic_305-5:495096Byte/second,topic_305-6:790801Byte/second,topic_305-7:145982Byte/second,topic_943-0:93402Byte/second,topic_943-1:71006Byte/second,topic_943-2:1073Byte/second,topic_943-3:62732Byte/second,topic_943-4:9509Byte/second,topic_943-5:80493Byte/second,topic_943-6:106613Byte/second,topic_943-7:94875Byte/second,topic_943-8:29376Byte/second,topic_943-9:112179Byte/second,topic_943-10:34343Byte/second,topic_943-11:64597Byte/second,topic_943-12:55030Byte/second,topic_669-0:57892Byte/second,topic_669-1:212102Byte/second,topic_669-2:96303Byte/second,topic_669-3:83610Byte/second,topic_669-4:77067Byte/second,topic_669-5:109243Byte/second,topic_669-6:152357Byte/second,topic_781-0:80436Byte/second,topic_781-1:110214Byte/second,topic_781-2:68818Byte/second,topic_781-3:115708Byte/second,topic_781-4:66852Byte/second,topic_781-5:18490Byte/second,topic_781-6:86537Byte/second,topic_781-7:25122Byte/second,topic_781-8:195903Byte/second,topic_781-9:36205Byte/second,topic_781-10:43980Byte/second,topic_781-11:58908Byte/second,topic_540-0:8397Byte/second,topic_540-1:29329Byte/second,topic_540-2:135912Byte/second,topic_540-3:130121Byte/second,topic_540-4:148741Byte/second,topic_540-5:115933Byte/second,topic_540-6:108286Byte/second,topic_540-7:64030Byte/second,topic_540-8:42808Byte/second,topic_540-9:109865Byte/second,topic_787-0:93971Byte/second,topic_787-1:94670Byte/second,topic_787-2:73044Byte/second,topic_787-3:176946Byte/second,topic_787-4:40926Byte/second,topic_787-5:75124Byte/second,topic_787-6:114149Byte/second,topic_787-7:9059Byte/second,topic_666-0:220267Byte/second,topic_666-1:84889Byte/second,topic_666-2:5792Byte/second,topic_666-3:123382Byte/second,topic_666-4:166618Byte/second,topic_666-5:191320Byte/second,topic_666-6:56759Byte/second,topic_666-7:226326Byte/second,topic_666-8:122802Byte/second,topic_304-0:13754Byte/second,topic_304-1:76565Byte/second,topic_304-2:87442Byte/second,topic_304-3:284077Byte/second,topic_304-4:320036Byte/second,topic_942-0:201349Byte/second,topic_942-1:179354Byte/second,topic_942-2:191060Byte/second,topic_942-3:138050Byte/second,topic_942-4:288291Byte/second,topic_942-5:244455Byte/second,topic_942-6:159251Byte/second,topic_942-7:49116Byte/second,topic_942-8:267451Byte/second,topic_942-9:73004Byte/second,topic_942-10:167732Byte/second,topic_942-11:30555Byte/second,topic_942-12:120524Byte/second,topic_268-0:223244Byte/second,topic_268-1:32063Byte/second,topic_268-2:237335Byte/second,topic_268-3:231930Byte/second,topic_268-4:195088Byte/second,topic_268-5:235831Byte/second,topic_268-6:253062Byte/second,topic_268-7:19614Byte/second,topic_268-8:145431Byte/second,topic_268-9:184642Byte/second,topic_268-10:93595Byte/second,topic_268-11:149042Byte/second,topic_268-12:145305Byte/second,topic_664-0:251208Byte/second,topic_664-1:304451Byte/second,topic_664-2:519342Byte/second,topic_664-3:469298Byte/second,topic_664-4:10411Byte/second,topic_664-5:282072Byte/second,topic_664-6:360610Byte/second,topic_148-0:410077Byte/second,topic_148-1:262866Byte/second,topic_148-2:113109Byte/second,topic_148-3:3789Byte/second,topic_148-4:211011Byte/second,topic_148-5:3497Byte/second,topic_148-6:86568Byte/second,topic_148-7:278110Byte/second,topic_148-8:365468Byte/second,topic_148-9:136340Byte/second,topic_148-10:211696Byte/second,topic_148-11:319436Byte/second,topic_148-12:4840Byte/second,topic_148-13:307545Byte/second,topic_148-14:328963Byte/second,topic_391-0:542262Byte/second,topic_391-1:110281Byte/second,topic_391-2:222166Byte/second,topic_391-3:563801Byte/second,topic_391-4:293540Byte/second,topic_391-5:239517Byte/second,topic_391-6:140593Byte/second,topic_273-0:137952Byte/second,topic_273-1:87655Byte/second,topic_273-2:168338Byte/second,topic_273-3:48560Byte/second,topic_273-4:173680Byte/second,topic_273-5:134243Byte/second,topic_273-6:18554Byte/second,topic_273-7:186920Byte/second,topic_273-8:184101Byte/second,topic_273-9:7207Byte/second,topic_273-10:24616Byte/second,topic_273-11:171770Byte/second,topic_273-12:140261Byte/second,topic_273-13:142318Byte/second,topic_273-14:163699Byte/second,topic_791-0:978262Byte/second,topic_791-1:159591Byte/second,topic_791-2:262945Byte/second,topic_791-3:127976Byte/second,topic_791-4:407763Byte/second,topic_791-5:225256Byte/second,topic_395-0:230032Byte/second,topic_395-1:273507Byte/second,topic_395-2:209883Byte/second,topic_395-3:65468Byte/second,topic_395-4:215899Byte/second,topic_395-5:83593Byte/second,topic_395-6:88246Byte/second,topic_395-7:36797Byte/second,topic_395-8:28490Byte/second,topic_395-9:242795Byte/second,topic_395-10:8548Byte/second,topic_395-11:168768Byte/second,topic_395-12:211829Byte/second,topic_395-13:234184Byte/second,topic_150-0:398053Byte/second,topic_150-1:332118Byte/second,topic_150-2:312264Byte/second,topic_150-3:47545Byte/second,topic_150-4:389015Byte/second,topic_150-5:198776Byte/second,topic_150-6:246417Byte/second,topic_150-7:46882Byte/second,topic_150-8:286226Byte/second,topic_150-9:270566Byte/second,topic_52-0:532419Byte/second,topic_52-1:481023Byte/second,topic_52-2:210317Byte/second,topic_52-3:501745Byte/second,topic_52-4:512166Byte/second,topic_417-0:778379Byte/second,topic_417-1:91582Byte/second,topic_417-2:47613Byte/second,topic_417-3:488591Byte/second,topic_417-4:969525Byte/second,topic_417-5:229793Byte/second,topic_46-0:548675Byte/second,topic_46-1:415348Byte/second,topic_46-2:109162Byte/second,topic_46-3:549776Byte/second,topic_46-4:537216Byte/second,topic_812-0:429057Byte/second,topic_812-1:624975Byte/second,topic_812-2:574777Byte/second,topic_812-3:70414Byte/second,topic_812-4:147795Byte/second,topic_812-5:109187Byte/second,topic_812-6:457404Byte/second,topic_812-7:356125Byte/second,topic_812-8:676354Byte/second,topic_818-0:369995Byte/second,topic_818-1:296748Byte/second,topic_818-2:153229Byte/second,topic_818-3:382620Byte/second,topic_818-4:106100Byte/second,topic_818-5:333782Byte/second,topic_818-6:226448Byte/second,topic_818-7:78064Byte/second,topic_818-8:154862Byte/second,topic_818-9:24796Byte/second,topic_936-0:280718Byte/second,topic_936-1:903Byte/second,topic_936-2:249686Byte/second,topic_936-3:254209Byte/second,topic_936-4:258504Byte/second,topic_936-5:135746Byte/second,topic_936-6:171108Byte/second,topic_936-7:210296Byte/second,topic_936-8:165119Byte/second,topic_936-9:35457Byte/second,topic_936-10:215169Byte/second,topic_936-11:106723Byte/second,topic_530-0:63828Byte/second,topic_530-1:141975Byte/second,topic_530-2:35334Byte/second,topic_530-3:216747Byte/second,topic_530-4:111040Byte/second,topic_530-5:115538Byte/second,topic_530-6:65278Byte/second,topic_530-7:201770Byte/second,topic_530-8:133014Byte/second,topic_530-9:191868Byte/second,topic_530-10:25264Byte/second,topic_651-0:298814Byte/second,topic_651-1:167958Byte/second,topic_651-2:180013Byte/second,topic_651-3:129196Byte/second,topic_651-4:165762Byte/second,topic_651-5:276418Byte/second,topic_651-6:46407Byte/second,topic_651-7:129496Byte/second,topic_651-8:225880Byte/second,topic_651-9:254413Byte/second,topic_651-10:118907Byte/second,topic_651-11:11187Byte/second,topic_651-12:37662Byte/second,topic_651-13:279644Byte/second,topic_651-14:154719Byte/second,topic_773-0:353758Byte/second,topic_773-1:101113Byte/second,topic_773-2:241256Byte/second,topic_773-3:486044Byte/second,topic_773-4:20756Byte/second,topic_773-5:317234Byte/second,topic_773-6:256737Byte/second,topic_773-7:341650Byte/second,topic_773-8:171429Byte/second,topic_773-9:369626Byte/second,topic_773-10:22929Byte/second,topic_498-0:44456Byte/second,topic_498-1:90451Byte/second,topic_498-2:114009Byte/second,topic_498-3:5830Byte/second,topic_498-4:154842Byte/second,topic_498-5:67311Byte/second,topic_498-6:149496Byte/second,topic_498-7:44157Byte/second,topic_498-8:111950Byte/second,topic_498-9:100234Byte/second,topic_498-10:85195Byte/second,topic_498-11:92132Byte/second,topic_498-12:7874Byte/second,topic_495-0:33672Byte/second,topic_495-1:30880Byte/second,topic_495-2:184995Byte/second,topic_495-3:81510Byte/second,topic_495-4:153222Byte/second,topic_495-5:172265Byte/second,topic_495-6:109541Byte/second,topic_495-7:28443Byte/second,topic_495-8:21226Byte/second,topic_495-9:138474Byte/second,topic_495-10:125280Byte/second,topic_253-0:20448Byte/second,topic_253-1:268780Byte/second,topic_253-2:20096Byte/second,topic_253-3:64575Byte/second,topic_253-4:270785Byte/second,topic_253-5:22272Byte/second,topic_253-6:237068Byte/second,topic_253-7:219725Byte/second,topic_253-8:411092Byte/second,topic_375-0:45666Byte/second,topic_375-1:52349Byte/second,topic_375-2:84339Byte/second,topic_375-3:18044Byte/second,topic_375-4:9649Byte/second,topic_375-5:106951Byte/second,topic_375-6:89350Byte/second,topic_375-7:40208Byte/second,topic_375-8:54007Byte/second,topic_375-9:86524Byte/second,topic_375-10:9293Byte/second,topic_375-11:72658Byte/second,topic_375-12:11604Byte/second,topic_375-13:79252Byte/second,topic_375-14:102381Byte/second,topic_931-0:178684Byte/second,topic_931-1:24754Byte/second,topic_931-2:151420Byte/second,topic_931-3:23438Byte/second,topic_931-4:57067Byte/second,topic_931-5:121220Byte/second,topic_931-6:86842Byte/second,topic_931-7:153404Byte/second,topic_931-8:163803Byte/second,topic_931-9:49493Byte/second,topic_931-10:76515Byte/second,topic_931-11:147577Byte/second,topic_931-12:19168Byte/second,topic_774-0:244373Byte/second,topic_774-1:166813Byte/second,topic_774-2:205332Byte/second,topic_774-3:155785Byte/second,topic_774-4:96870Byte/second,topic_774-5:18230Byte/second,topic_774-6:80051Byte/second,topic_774-7:115866Byte/second,topic_774-8:71651Byte/second,topic_774-9:306831Byte/second,topic_774-10:145241Byte/second,topic_774-11:173438Byte/second,topic_774-12:204815Byte/second,topic_774-13:128769Byte/second,topic_532-0:296428Byte/second,topic_532-1:222220Byte/second,topic_532-2:32951Byte/second,topic_532-3:6710Byte/second,topic_532-4:181977Byte/second,topic_532-5:308718Byte/second,topic_532-6:24662Byte/second,topic_532-7:226038Byte/second,topic_532-8:255704Byte/second,topic_532-9:291090Byte/second,topic_532-10:308916Byte/second,topic_532-11:120746Byte/second,topic_532-12:314378Byte/second,topic_532-13:40584Byte/second,topic_137-0:390461Byte/second,topic_137-1:704810Byte/second,topic_137-2:78742Byte/second,topic_137-3:99650Byte/second,topic_137-4:259404Byte/second,topic_137-5:633739Byte/second,topic_137-6:610481Byte/second,topic_258-0:89902Byte/second,topic_258-1:119904Byte/second,topic_258-2:104486Byte/second,topic_258-3:58190Byte/second,topic_258-4:103910Byte/second,topic_258-5:112844Byte/second,topic_258-6:91179Byte/second,topic_258-7:88731Byte/second,topic_258-8:112752Byte/second,topic_258-9:47619Byte/second,topic_258-10:15293Byte/second,topic_258-11:29108Byte/second,topic_258-12:66302Byte/second,topic_258-13:91926Byte/second,topic_262-0:45551Byte/second,topic_262-1:244607Byte/second,topic_262-2:77187Byte/second,topic_262-3:240820Byte/second,topic_262-4:308762Byte/second,topic_262-5:307112Byte/second,topic_262-6:240870Byte/second,topic_262-7:26933Byte/second,topic_262-8:2229Byte/second,topic_262-9:214596Byte/second,topic_262-10:85649Byte/second,topic_262-11:287276Byte/second,topic_262-12:133254Byte/second,topic_262-13:88613Byte/second,topic_383-0:90601Byte/second,topic_383-1:154151Byte/second,topic_383-2:179210Byte/second,topic_383-3:207464Byte/second,topic_383-4:217909Byte/second,topic_383-5:127513Byte/second,topic_383-6:281967Byte/second,topic_383-7:2131Byte/second,topic_383-8:32726Byte/second,topic_383-9:178598Byte/second,topic_383-10:203522Byte/second,topic_383-11:60837Byte/second,topic_383-12:185375Byte/second,topic_383-13:9015Byte/second,topic_383-14:86789Byte/second,topic_780-0:979025Byte/second,topic_780-1:255795Byte/second,topic_780-2:516154Byte/second,topic_780-3:168815Byte/second,topic_780-4:143108Byte/second,topic_140-0:70336Byte/second,topic_140-1:488720Byte/second,topic_140-2:278589Byte/second,topic_140-3:505743Byte/second,topic_140-4:528478Byte/second,topic_140-5:52829Byte/second,topic_140-6:323289Byte/second,topic_726-0:640527Byte/second,topic_726-1:168464Byte/second,topic_726-2:239475Byte/second,topic_726-3:436464Byte/second,topic_726-4:524228Byte/second,topic_726-5:206967Byte/second,topic_726-6:189336Byte/second,topic_726-7:476868Byte/second,topic_726-8:186332Byte/second,topic_726-9:315059Byte/second,topic_206-0:602832Byte/second,topic_206-1:562711Byte/second,topic_206-2:133164Byte/second,topic_206-3:584180Byte/second,topic_206-4:65340Byte/second,topic_206-5:560365Byte/second,topic_602-0:6267Byte/second,topic_602-1:40891Byte/second,topic_602-2:293420Byte/second,topic_602-3:81205Byte/second,topic_602-4:119230Byte/second,topic_602-5:253168Byte/second,topic_602-6:172818Byte/second,topic_602-7:445022Byte/second,topic_602-8:67819Byte/second,topic_602-9:356186Byte/second,topic_328-0:91604Byte/second,topic_328-1:101058Byte/second,topic_328-2:110928Byte/second,topic_328-3:112165Byte/second,topic_328-4:97498Byte/second,topic_328-5:85399Byte/second,topic_328-6:57680Byte/second,topic_328-7:28263Byte/second,topic_328-8:96010Byte/second,topic_328-9:68842Byte/second,topic_328-10:85010Byte/second,topic_328-11:75826Byte/second,topic_328-12:38143Byte/second,topic_328-13:58746Byte/second,topic_848-0:230761Byte/second,topic_848-1:326042Byte/second,topic_848-2:173561Byte/second,topic_848-3:439202Byte/second,topic_848-4:372860Byte/second,topic_848-5:474297Byte/second,topic_848-6:65924Byte/second,topic_848-7:336984Byte/second,topic_848-8:2664Byte/second,topic_288-0:68608Byte/second,topic_288-1:87418Byte/second,topic_288-2:140754Byte/second,topic_288-3:851Byte/second,topic_288-4:100828Byte/second,topic_288-5:165721Byte/second,topic_288-6:83968Byte/second,topic_288-7:9757Byte/second,topic_288-8:63138Byte/second,topic_288-9:56903Byte/second,topic_288-10:139820Byte/second,topic_288-11:126637Byte/second,topic_561-0:44354Byte/second,topic_561-1:69567Byte/second,topic_561-2:61327Byte/second,topic_561-3:89198Byte/second,topic_561-4:1173Byte/second,topic_561-5:76602Byte/second,topic_561-6:40052Byte/second,topic_561-7:97122Byte/second,topic_561-8:99025Byte/second,topic_561-9:77199Byte/second,topic_561-10:45706Byte/second,topic_562-0:232832Byte/second,topic_562-1:164621Byte/second,topic_562-2:137155Byte/second,topic_562-3:426789Byte/second,topic_562-4:46112Byte/second,topic_562-5:71340Byte/second,topic_562-6:106411Byte/second,topic_562-7:184356Byte/second,topic_683-0:40829Byte/second,topic_683-1:263533Byte/second,topic_683-2:234802Byte/second,topic_683-3:95900Byte/second,topic_683-4:120542Byte/second,topic_683-5:242592Byte/second,topic_683-6:116424Byte/second,topic_683-7:125692Byte/second,topic_683-8:121886Byte/second,topic_683-9:13641Byte/second,topic_683-10:184126Byte/second,topic_683-11:57050Byte/second,topic_683-12:255437Byte/second,topic_683-13:251165Byte/second,topic_683-14:113512Byte/second,topic_446-0:818001Byte/second,topic_446-1:36814Byte/second,topic_446-2:1303112Byte/second,topic_446-3:1314721Byte/second,topic_446-4:1032660Byte/second,topic_446-5:210110Byte/second,topic_446-6:782715Byte/second,topic_204-0:232939Byte/second,topic_204-1:331269Byte/second,topic_204-2:454040Byte/second,topic_204-3:341354Byte/second,topic_204-4:454728Byte/second,topic_204-5:631067Byte/second,topic_600-0:263687Byte/second,topic_600-1:310787Byte/second,topic_600-2:180426Byte/second,topic_600-3:307848Byte/second,topic_600-4:309528Byte/second,topic_600-5:333914Byte/second,topic_600-6:67791Byte/second,topic_600-7:197255Byte/second,topic_600-8:209534Byte/second,topic_600-9:337308Byte/second,topic_689-0:90222Byte/second,topic_689-1:105481Byte/second,topic_689-2:142124Byte/second,topic_689-3:53489Byte/second,topic_689-4:83105Byte/second,topic_689-5:111364Byte/second,topic_689-6:40238Byte/second,topic_689-7:105451Byte/second,topic_689-8:137204Byte/second,topic_689-9:15755Byte/second,topic_689-10:87195Byte/second,topic_689-11:139965Byte/second,topic_689-12:146052Byte/second,topic_689-13:131496Byte/second,topic_689-14:106688Byte/second,topic_843-0:180402Byte/second,topic_843-1:590690Byte/second,topic_843-2:17367Byte/second,topic_843-3:243131Byte/second,topic_843-4:30973Byte/second,topic_843-5:540744Byte/second,topic_843-6:462876Byte/second,topic_843-7:24254Byte/second,topic_843-8:582286Byte/second,topic_169-0:448133Byte/second,topic_169-1:414967Byte/second,topic_169-2:240232Byte/second,topic_169-3:257169Byte/second,topic_169-4:370170Byte/second,topic_169-5:30337Byte/second,topic_169-6:290868Byte/second,topic_169-7:102885Byte/second,topic_324-0:293529Byte/second,topic_324-1:66836Byte/second,topic_324-2:417167Byte/second,topic_324-3:80991Byte/second,topic_324-4:167317Byte/second,topic_324-5:68009Byte/second,topic_324-6:249411Byte/second,topic_324-7:188582Byte/second,topic_324-8:425481Byte/second,topic_324-9:355674Byte/second,topic_324-10:139004Byte/second,topic_324-11:157497Byte/second,topic_324-12:42171Byte/second,topic_324-13:514727Byte/second,topic_324-14:508184Byte/second,topic_445-0:241337Byte/second,topic_445-1:229687Byte/second,topic_445-2:22171Byte/second,topic_445-3:235431Byte/second,topic_445-4:68096Byte/second,topic_445-5:281690Byte/second,topic_445-6:297261Byte/second,topic_445-7:254077Byte/second,topic_445-8:165136Byte/second,topic_445-9:30743Byte/second,topic_445-10:311116Byte/second,topic_445-11:171925Byte/second,topic_445-12:269992Byte/second,topic_171-0:392083Byte/second,topic_171-1:364723Byte/second,topic_171-2:449882Byte/second,topic_171-3:261144Byte/second,topic_171-4:280834Byte/second,topic_171-5:441571Byte/second,topic_290-0:64192Byte/second,topic_290-1:184420Byte/second,topic_290-2:149546Byte/second,topic_290-3:124974Byte/second,topic_290-4:58584Byte/second,topic_290-5:91576Byte/second,topic_290-6:61174Byte/second,topic_290-7:119801Byte/second,topic_290-8:73424Byte/second,topic_290-9:45723Byte/second,topic_290-10:85095Byte/second,topic_290-11:69363Byte/second,topic_290-12:109022Byte/second,topic_174-0:263825Byte/second,topic_174-1:353902Byte/second,topic_174-2:389377Byte/second,topic_174-3:552298Byte/second,topic_174-4:537099Byte/second,topic_174-5:481105Byte/second,topic_174-6:20290Byte/second,topic_571-0:201967Byte/second,topic_571-1:38192Byte/second,topic_571-2:119502Byte/second,topic_571-3:161791Byte/second,topic_571-4:101760Byte/second,topic_571-5:66959Byte/second,topic_571-6:54353Byte/second,topic_571-7:22148Byte/second,topic_293-0:63807Byte/second,topic_293-1:146374Byte/second,topic_293-2:111378Byte/second,topic_293-3:139845Byte/second,topic_293-4:27688Byte/second,topic_293-5:81917Byte/second,topic_293-6:265081Byte/second,topic_293-7:38486Byte/second,topic_293-8:145977Byte/second,topic_319-0:87460Byte/second,topic_319-1:64154Byte/second,topic_319-2:55955Byte/second,topic_319-3:71918Byte/second,topic_319-4:19473Byte/second,topic_319-5:54382Byte/second,topic_319-6:80834Byte/second,topic_319-7:88856Byte/second,topic_319-8:108139Byte/second,topic_319-9:32784Byte/second,topic_319-10:87364Byte/second,topic_319-11:3999Byte/second,topic_319-12:53713Byte/second,topic_836-0:343315Byte/second,topic_836-1:209510Byte/second,topic_836-2:293875Byte/second,topic_836-3:125405Byte/second,topic_836-4:121335Byte/second,topic_836-5:150582Byte/second,topic_836-6:104198Byte/second,topic_836-7:184292Byte/second,topic_836-8:268402Byte/second,topic_836-9:29103Byte/second,topic_836-10:121031Byte/second,topic_836-11:243391Byte/second,topic_836-12:294177Byte/second,topic_437-0:77481Byte/second,topic_437-1:132267Byte/second,topic_437-2:171587Byte/second,topic_437-3:183440Byte/second,topic_437-4:136737Byte/second,topic_437-5:19522Byte/second,topic_437-6:91779Byte/second,topic_437-7:95510Byte/second,topic_437-8:202451Byte/second,topic_437-9:126338Byte/second,topic_437-10:79138Byte/second,topic_437-11:20576Byte/second,topic_437-12:127361Byte/second,topic_713-0:233241Byte/second,topic_713-1:275552Byte/second,topic_713-2:280678Byte/second,topic_713-3:237413Byte/second,topic_713-4:231056Byte/second,topic_713-5:67943Byte/second,topic_713-6:106714Byte/second,topic_713-7:291388Byte/second,topic_713-8:141363Byte/second,topic_713-9:92236Byte/second,topic_713-10:84967Byte/second,topic_713-11:56254Byte/second,topic_713-12:309002Byte/second,topic_713-13:281236Byte/second,topic_959-0:345474Byte/second,topic_959-1:746929Byte/second,topic_959-2:22080Byte/second,topic_959-3:966632Byte/second,topic_959-4:406258Byte/second,topic_278-0:57218Byte/second,topic_278-1:549428Byte/second,topic_278-2:406556Byte/second,topic_278-3:145235Byte/second,topic_278-4:667754Byte/second,topic_278-5:303985Byte/second,topic_793-0:939457Byte/second,topic_793-1:378560Byte/second,topic_793-2:215230Byte/second,topic_793-3:512170Byte/second,topic_793-4:394724Byte/second,topic_397-0:95399Byte/second,topic_397-1:36513Byte/second,topic_397-2:148171Byte/second,topic_397-3:63858Byte/second,topic_397-4:77060Byte/second,topic_397-5:152115Byte/second,topic_397-6:88033Byte/second,topic_397-7:110007Byte/second,topic_397-8:116930Byte/second,topic_397-9:95266Byte/second,topic_397-10:7363Byte/second,topic_397-11:11115Byte/second,topic_397-12:84546Byte/second,topic_397-13:10059Byte/second,topic_556-0:191087Byte/second,topic_556-1:140064Byte/second,topic_556-2:555071Byte/second,topic_556-3:331443Byte/second,topic_556-4:469496Byte/second,topic_556-5:473897Byte/second,topic_556-6:221650Byte/second,topic_556-7:128210Byte/second,topic_952-0:215009Byte/second,topic_952-1:130749Byte/second,topic_952-2:297000Byte/second,topic_952-3:363296Byte/second,topic_952-4:86293Byte/second,topic_952-5:414266Byte/second,topic_952-6:271389Byte/second,topic_952-7:277053Byte/second,topic_435-0:75619Byte/second,topic_435-1:214458Byte/second,topic_435-2:211180Byte/second,topic_435-3:708596Byte/second,topic_435-4:426835Byte/second,topic_435-5:643983Byte/second,topic_435-6:395497Byte/second,topic_435-7:675183Byte/second,topic_435-8:370062Byte/second,topic_435-9:105804Byte/second,topic_435-10:667923Byte/second,topic_435-11:260838Byte/second,topic_678-0:45038Byte/second,topic_678-1:107990Byte/second,topic_678-2:66764Byte/second,topic_678-3:3485Byte/second,topic_678-4:119722Byte/second,topic_678-5:75382Byte/second,topic_678-6:47049Byte/second,topic_678-7:31135Byte/second,topic_678-8:109656Byte/second,topic_678-9:21678Byte/second,topic_678-10:29348Byte/second,topic_678-11:45956Byte/second,topic_796-0:147128Byte/second,topic_796-1:151803Byte/second,topic_796-2:151725Byte/second,topic_796-3:51193Byte/second,topic_796-4:10467Byte/second,topic_796-5:88967Byte/second,topic_796-6:123147Byte/second,topic_796-7:94775Byte/second,topic_796-8:74504Byte/second,topic_796-9:158803Byte/second,topic_796-10:20149Byte/second,topic_796-11:50032Byte/second,topic_796-12:172845Byte/second,topic_796-13:159097Byte/second,topic_796-14:119006Byte/second,topic_158-0:461339Byte/second,topic_158-1:275792Byte/second,topic_158-2:92776Byte/second,topic_158-3:353788Byte/second,topic_158-4:625318Byte/second,topic_158-5:862164Byte/second,topic_313-0:42291Byte/second,topic_313-1:4304Byte/second,topic_313-2:153901Byte/second,topic_313-3:134319Byte/second,topic_313-4:340390Byte/second,topic_313-5:42962Byte/second,topic_313-6:168437Byte/second,topic_313-7:148788Byte/second,topic_680-0:106491Byte/second,topic_680-1:37720Byte/second,topic_680-2:120333Byte/second,topic_680-3:80522Byte/second,topic_680-4:38208Byte/second,topic_680-5:60991Byte/second,topic_680-6:110402Byte/second,topic_680-7:176900Byte/second,topic_680-8:39835Byte/second,topic_680-9:33014Byte/second,topic_680-10:98384Byte/second,topic_680-11:117635Byte/second,topic_680-12:46740Byte/second,topic_285-0:370813Byte/second,topic_285-1:523413Byte/second,topic_285-2:102240Byte/second,topic_285-3:327037Byte/second,topic_285-4:499660Byte/second,topic_285-5:198863Byte/second,topic_285-6:532944Byte/second,topic_285-7:447625Byte/second,topic_164-0:341805Byte/second,topic_164-1:141434Byte/second,topic_164-2:182785Byte/second,topic_164-3:441860Byte/second,topic_164-4:312464Byte/second,topic_161-0:250493Byte/second,topic_161-1:779839Byte/second,topic_161-2:90654Byte/second,topic_161-3:157438Byte/second,topic_161-4:487301Byte/second,topic_161-5:784072Byte/second,topic_161-6:883084Byte/second,topic_161-7:676254Byte/second,topic_161-8:554279Byte/second,topic_21-0:367782Byte/second,topic_21-1:162691Byte/second,topic_21-2:441315Byte/second,topic_21-3:259707Byte/second,topic_21-4:240455Byte/second,topic_21-5:258332Byte/second,topic_21-6:351487Byte/second,topic_21-7:60756Byte/second,topic_21-8:404691Byte/second,topic_21-9:79618Byte/second,topic_21-10:17018Byte/second,topic_748-0:504911Byte/second,topic_748-1:549910Byte/second,topic_748-2:112405Byte/second,topic_748-3:660387Byte/second,topic_748-4:321272Byte/second,topic_748-5:178925Byte/second,topic_748-6:413920Byte/second,topic_869-0:284735Byte/second,topic_869-1:274950Byte/second,topic_869-2:102480Byte/second,topic_869-3:211916Byte/second,topic_869-4:308504Byte/second,topic_869-5:278311Byte/second,topic_869-6:77057Byte/second,topic_869-7:273846Byte/second,topic_228-0:11636Byte/second,topic_228-1:287937Byte/second,topic_228-2:14817Byte/second,topic_228-3:152164Byte/second,topic_228-4:225980Byte/second,topic_624-0:167619Byte/second,topic_624-1:145419Byte/second,topic_624-2:47145Byte/second,topic_624-3:171706Byte/second,topic_624-4:223316Byte/second,topic_624-5:528674Byte/second,topic_624-6:309482Byte/second,topic_624-7:438112Byte/second,topic_13-0:398292Byte/second,topic_13-1:257221Byte/second,topic_13-2:300838Byte/second,topic_13-3:556665Byte/second,topic_13-4:565014Byte/second,topic_504-0:17996Byte/second,topic_504-1:146804Byte/second,topic_504-2:36202Byte/second,topic_504-3:37758Byte/second,topic_504-4:122764Byte/second,topic_504-5:58054Byte/second,topic_504-6:133450Byte/second,topic_504-7:56649Byte/second,topic_504-8:214921Byte/second,topic_504-9:147986Byte/second,topic_504-10:63430Byte/second,topic_867-0:219503Byte/second,topic_867-1:309207Byte/second,topic_867-2:5773Byte/second,topic_867-3:298303Byte/second,topic_867-4:64992Byte/second,topic_867-5:165116Byte/second,topic_867-6:202530Byte/second,topic_867-7:371110Byte/second,topic_867-8:198251Byte/second,topic_867-9:50895Byte/second,topic_867-10:62630Byte/second,topic_867-11:357297Byte/second,topic_867-12:225215Byte/second,topic_628-0:83091Byte/second,topic_628-1:114629Byte/second,topic_628-2:40860Byte/second,topic_628-3:79722Byte/second,topic_628-4:29923Byte/second,topic_628-5:146249Byte/second,topic_628-6:65305Byte/second,topic_628-7:65539Byte/second,topic_628-8:137614Byte/second,topic_628-9:115191Byte/second,topic_628-10:90444Byte/second,topic_628-11:48565Byte/second,topic_628-12:59104Byte/second,topic_628-13:140369Byte/second,topic_904-0:206110Byte/second,topic_904-1:99834Byte/second,topic_904-2:150667Byte/second,topic_904-3:274763Byte/second,topic_904-4:134115Byte/second,topic_904-5:282339Byte/second,topic_904-6:124601Byte/second,topic_904-7:222266Byte/second,topic_904-8:148286Byte/second,topic_904-9:244968Byte/second,topic_904-10:193584Byte/second,topic_904-11:122957Byte/second,topic_904-12:249403Byte/second,topic_18-0:190841Byte/second,topic_18-1:265361Byte/second,topic_18-2:373239Byte/second,topic_18-3:179958Byte/second,topic_18-4:458775Byte/second,topic_18-5:216737Byte/second,topic_18-6:333818Byte/second,topic_18-7:328712Byte/second,topic_18-8:24747Byte/second,topic_18-9:470244Byte/second,topic_18-10:137134Byte/second,topic_222-0:271586Byte/second,topic_222-1:330340Byte/second,topic_222-2:69704Byte/second,topic_222-3:320034Byte/second,topic_222-4:173753Byte/second,topic_222-5:13490Byte/second,topic_222-6:210214Byte/second,topic_222-7:79144Byte/second,topic_222-8:197183Byte/second,topic_222-9:75201Byte/second,topic_222-10:257016Byte/second,topic_222-11:171556Byte/second,topic_222-12:150311Byte/second,topic_982-0:317928Byte/second,topic_982-1:345338Byte/second,topic_982-2:459357Byte/second,topic_982-3:242137Byte/second,topic_982-4:104184Byte/second,topic_982-5:363051Byte/second,topic_982-6:252231Byte/second,topic_982-7:65596Byte/second,topic_341-0:36957Byte/second,topic_341-1:321081Byte/second,topic_341-2:338463Byte/second,topic_341-3:240728Byte/second,topic_341-4:128050Byte/second,topic_341-5:280995Byte/second,topic_341-6:116090Byte/second,topic_341-7:28974Byte/second,topic_341-8:305284Byte/second,topic_341-9:12021Byte/second,topic_341-10:283115Byte/second,topic_100-0:741844Byte/second,topic_100-1:322375Byte/second,topic_100-2:698657Byte/second,topic_100-3:101979Byte/second,topic_100-4:532557Byte/second,topic_100-5:452459Byte/second,topic_100-6:71718Byte/second,topic_100-7:605137Byte/second,topic_100-8:373991Byte/second,topic_743-0:40450Byte/second,topic_743-1:249912Byte/second,topic_743-2:776152Byte/second,topic_743-3:51755Byte/second,topic_743-4:715227Byte/second,topic_743-5:282431Byte/second,topic_743-6:522403Byte/second,topic_501-0:124866Byte/second,topic_501-1:104185Byte/second,topic_501-2:1930Byte/second,topic_501-3:78756Byte/second,topic_501-4:91375Byte/second,topic_501-5:29182Byte/second,topic_501-6:172868Byte/second,topic_501-7:48627Byte/second,topic_501-8:65633Byte/second,topic_501-9:58107Byte/second,topic_501-10:100638Byte/second,topic_501-11:166008Byte/second,topic_501-12:134344Byte/second,topic_226-0:93571Byte/second,topic_226-1:27131Byte/second,topic_226-2:87429Byte/second,topic_226-3:90130Byte/second,topic_226-4:66708Byte/second,topic_226-5:32975Byte/second,topic_226-6:29046Byte/second,topic_226-7:48440Byte/second,topic_226-8:86988Byte/second,topic_226-9:45860Byte/second,topic_226-10:55620Byte/second,topic_226-11:115652Byte/second,topic_226-12:42309Byte/second,topic_226-13:7495Byte/second,topic_226-14:56211Byte/second,topic_348-0:96840Byte/second,topic_348-1:19194Byte/second,topic_348-2:8028Byte/second,topic_348-3:59899Byte/second,topic_348-4:118434Byte/second,topic_348-5:59504Byte/second,topic_348-6:64555Byte/second,topic_348-7:125318Byte/second,topic_348-8:121898Byte/second,topic_348-9:103951Byte/second,topic_348-10:3858Byte/second,topic_348-11:22904Byte/second,topic_587-0:72382Byte/second,topic_587-1:6769Byte/second,topic_587-2:139170Byte/second,topic_587-3:71141Byte/second,topic_587-4:179930Byte/second,topic_587-5:344502Byte/second,topic_587-6:125057Byte/second,topic_587-7:341056Byte/second,topic_587-8:300324Byte/second,topic_587-9:46084Byte/second,topic_587-10:295305Byte/second,topic_587-11:127040Byte/second,topic_587-12:36581Byte/second,topic_587-13:135372Byte/second,topic_741-0:9874Byte/second,topic_741-1:75483Byte/second,topic_741-2:20595Byte/second,topic_741-3:160943Byte/second,topic_741-4:65495Byte/second,topic_741-5:117391Byte/second,topic_741-6:141447Byte/second,topic_741-7:139178Byte/second,topic_466-0:385448Byte/second,topic_466-1:215294Byte/second,topic_466-2:138700Byte/second,topic_466-3:399199Byte/second,topic_466-4:407309Byte/second,topic_466-5:249298Byte/second,topic_466-6:129748Byte/second,topic_466-7:175803Byte/second,topic_862-0:226346Byte/second,topic_862-1:203942Byte/second,topic_862-2:165777Byte/second,topic_862-3:183154Byte/second,topic_862-4:48292Byte/second,topic_862-5:68607Byte/second,topic_862-6:205107Byte/second,topic_862-7:103255Byte/second,topic_862-8:167356Byte/second,topic_862-9:130552Byte/second,topic_862-10:155924Byte/second,topic_983-0:388177Byte/second,topic_983-1:68110Byte/second,topic_983-2:68318Byte/second,topic_983-3:266161Byte/second,topic_983-4:371305Byte/second,topic_983-5:241590Byte/second,topic_983-6:24307Byte/second,topic_983-7:264602Byte/second,topic_983-8:209160Byte/second,topic_983-9:383399Byte/second,topic_863-0:91860Byte/second,topic_863-1:183448Byte/second,topic_863-2:179490Byte/second,topic_863-3:37312Byte/second,topic_863-4:40876Byte/second,topic_863-5:127827Byte/second,topic_863-6:38994Byte/second,topic_863-7:36112Byte/second,topic_863-8:112230Byte/second,topic_863-9:8777Byte/second,topic_863-10:16424Byte/second,topic_863-11:78810Byte/second,topic_863-12:162183Byte/second,topic_863-13:61802Byte/second,topic_190-0:1354366Byte/second,topic_190-1:256974Byte/second,topic_190-2:16019Byte/second,topic_190-3:653261Byte/second,topic_190-4:233996Byte/second,topic_351-0:639557Byte/second,topic_351-1:110634Byte/second,topic_351-2:446999Byte/second,topic_351-3:547449Byte/second,topic_351-4:245818Byte/second,topic_907-0:53231Byte/second,topic_907-1:33260Byte/second,topic_907-2:45861Byte/second,topic_907-3:52785Byte/second,topic_907-4:59350Byte/second,topic_907-5:85138Byte/second,topic_907-6:70221Byte/second,topic_907-7:40520Byte/second,topic_907-8:108369Byte/second,topic_907-9:15010Byte/second,topic_907-10:41625Byte/second,topic_907-11:68214Byte/second,topic_95-0:15069Byte/second,topic_95-1:368690Byte/second,topic_95-2:492291Byte/second,topic_95-3:110263Byte/second,topic_95-4:82040Byte/second,topic_95-5:225025Byte/second,topic_95-6:435011Byte/second,topic_95-7:228778Byte/second,topic_95-8:501096Byte/second,topic_736-0:123423Byte/second,topic_736-1:520883Byte/second,topic_736-2:418243Byte/second,topic_736-3:467269Byte/second,topic_736-4:329980Byte/second,topic_736-5:464933Byte/second,topic_736-6:28019Byte/second,topic_736-7:64261Byte/second,topic_736-8:32169Byte/second,topic_736-9:52825Byte/second,topic_736-10:39196Byte/second,topic_736-11:94852Byte/second,topic_736-12:137709Byte/second,topic_88-0:45499Byte/second,topic_88-1:32734Byte/second,topic_88-2:40837Byte/second,topic_88-3:16139Byte/second,topic_88-4:114342Byte/second,topic_88-5:171266Byte/second,topic_88-6:176124Byte/second,topic_88-7:83772Byte/second,topic_88-8:149303Byte/second,topic_219-0:206074Byte/second,topic_219-1:342733Byte/second,topic_219-2:227551Byte/second,topic_219-3:267898Byte/second,topic_219-4:105960Byte/second,topic_219-5:83434Byte/second,topic_219-6:267769Byte/second,topic_219-7:357418Byte/second,topic_219-8:96096Byte/second,topic_219-9:87801Byte/second,topic_615-0:134372Byte/second,topic_615-1:289454Byte/second,topic_615-2:319569Byte/second,topic_615-3:335051Byte/second,topic_615-4:327724Byte/second,topic_615-5:151285Byte/second,topic_615-6:133093Byte/second,topic_615-7:69798Byte/second,topic_615-8:277006Byte/second,topic_858-0:188932Byte/second,topic_858-1:246081Byte/second,topic_858-2:224459Byte/second,topic_858-3:131327Byte/second,topic_858-4:19322Byte/second,topic_858-5:134964Byte/second,topic_858-6:219587Byte/second,topic_858-7:35138Byte/second,topic_858-8:61638Byte/second,topic_858-9:37042Byte/second,topic_977-0:392910Byte/second,topic_977-1:286535Byte/second,topic_977-2:491326Byte/second,topic_977-3:548688Byte/second,topic_977-4:114912Byte/second,topic_977-5:68872Byte/second,topic_739-0:25375Byte/second,topic_739-1:161260Byte/second,topic_739-2:192144Byte/second,topic_739-3:414210Byte/second,topic_739-4:42019Byte/second,topic_739-5:321736Byte/second,topic_739-6:46638Byte/second,topic_739-7:295856Byte/second,topic_739-8:261388Byte/second,topic_739-9:142075Byte/second,topic_739-10:417148Byte/second,topic_618-0:11472Byte/second,topic_618-1:72261Byte/second,topic_618-2:52601Byte/second,topic_618-3:11712Byte/second,topic_618-4:163603Byte/second,topic_618-5:49371Byte/second,topic_618-6:121115Byte/second,topic_618-7:135517Byte/second,topic_618-8:139490Byte/second,topic_618-9:156376Byte/second,topic_618-10:43994Byte/second,topic_618-11:132107Byte/second,topic_850-0:405148Byte/second,topic_850-1:538016Byte/second,topic_850-2:244490Byte/second,topic_850-3:671551Byte/second,topic_850-4:685322Byte/second,topic_850-5:633947Byte/second,topic_451-0:581784Byte/second,topic_451-1:3010138Byte/second,topic_451-2:2495231Byte/second,topic_451-3:143508Byte/second,topic_451-4:2168963Byte/second,topic_451-5:341793Byte/second,topic_452-0:50921Byte/second,topic_452-1:253150Byte/second,topic_452-2:12088Byte/second,topic_452-3:78700Byte/second,topic_452-4:123162Byte/second,topic_452-5:93936Byte/second,topic_452-6:31274Byte/second,topic_452-7:125334Byte/second,topic_452-8:144592Byte/second,topic_452-9:137553Byte/second,topic_452-10:194693Byte/second,topic_452-11:85726Byte/second,topic_452-12:174153Byte/second,topic_452-13:52814Byte/second,topic_455-0:552314Byte/second,topic_455-1:481642Byte/second,topic_455-2:239865Byte/second,topic_455-3:642552Byte/second,topic_455-4:1360102Byte/second,topic_456-0:449219Byte/second,topic_456-1:79645Byte/second,topic_456-2:135282Byte/second,topic_456-3:67414Byte/second,topic_456-4:338220Byte/second,topic_581-0:289374Byte/second,topic_581-1:102315Byte/second,topic_581-2:221390Byte/second,topic_581-3:238968Byte/second,topic_581-4:302720Byte/second,topic_186-0:180399Byte/second,topic_186-1:340526Byte/second,topic_186-2:659725Byte/second,topic_186-3:598477Byte/second,topic_186-4:630520Byte/second,topic_186-5:280862Byte/second,topic_186-6:193302Byte/second,topic_87-0:466811Byte/second,topic_87-1:298046Byte/second,topic_87-2:286761Byte/second,topic_87-3:200226Byte/second,topic_87-4:540017Byte/second,topic_87-5:376195Byte/second,topic_87-6:305354Byte/second,topic_87-7:580521Byte/second,topic_87-8:436027Byte/second,topic_87-9:226552Byte/second,topic_87-10:324590Byte/second,topic_87-11:297505Byte/second --producers 16 --consumers 24 --run.until 1day --key.size 10KiB --key.distribution zipfian --bootstrap.servers 192.168.103.177:25655,192.168.103.178:25655,192.168.103.179:25655,192.168.103.180:25655,192.168.103.181:25655,192.168.103.182:25655",
      "egress": "500.88 MB/seconds",
      "ingress": "359.95 MB/seconds"
    },
    { ... },
    { ... },
    { ... },
    { ... },
    { ... },
    { ... },
  ],
  "topicConsumerFanout": {
    "backbone": 1,
    "topic_0": 0,
    "topic_1": 1,
    "topic_10": 1,
    "topic_100": 1,
    "topic_101": 1,
    // ...
    "topic_970": 1,
    "topic_971": 1,
    "topic_972": 1,
    "topic_973": 0,
    "topic_974": 0,
    "topic_975": 1,
    "topic_976": 0,
    "topic_977": 3,
    "topic_978": 0,
    "topic_979": 0,
    "topic_98": 0,
    "topic_980": 1,
    "topic_981": 1,
    "topic_982": 1,
    "topic_983": 1,
    "topic_984": 2,
    "topic_985": 2,
    "topic_986": 2,
    "topic_987": 1,
    "topic_988": 0,
    "topic_989": 2,
    "topic_99": 3,
    "topic_990": 0,
    "topic_991": 1,
    "topic_992": 1,
    "topic_993": 1,
    "topic_994": 0,
    "topic_995": 1,
    "topic_996": 1,
    "topic_997": 1,
    "topic_998": 2,
    "topic_999": 0
  },
  "topicDataRate": {
    "backbone": "504.18 MB/seconds",
    "topic_0": "2.65 MB/seconds",
    "topic_1": "2.21 MB/seconds",
    "topic_10": "2.35 MB/seconds",
    "topic_100": "3.90 MB/seconds",
    "topic_101": "2.74 MB/seconds",
    "topic_102": "4.30 MB/seconds",
    "topic_103": "2.25 MB/seconds",
    // ...
    "topic_984": "2.31 MB/seconds",
    "topic_985": "3.39 MB/seconds",
    "topic_986": "2.13 MB/seconds",
    "topic_987": "2.16 MB/seconds",
    "topic_988": "2.02 MB/seconds",
    "topic_989": "5.36 MB/seconds",
    "topic_99": "7.99 MB/seconds",
    "topic_990": "7.31 MB/seconds",
    "topic_991": "2.33 MB/seconds",
    "topic_992": "2.20 MB/seconds",
    "topic_993": "2.43 MB/seconds",
    "topic_994": "2.21 MB/seconds",
    "topic_995": "5.58 MB/seconds",
    "topic_996": "3.54 MB/seconds",
    "topic_997": "5.34 MB/seconds",
    "topic_998": "2.10 MB/seconds",
    "topic_999": "2.51 MB/seconds"
  },
  "topicDataRateHistogram": {
    "[2.00 MB/seconds, 2.19 MB/seconds]": "250",
    "[2.19 MB/seconds, 2.41 MB/seconds]": "187",
    "[2.41 MB/seconds, 2.64 MB/seconds]": "141",
    "[2.65 MB/seconds, 2.92 MB/seconds]": "105",
    "[2.93 MB/seconds, 3.24 MB/seconds]": "79",
    "[3.24 MB/seconds, 3.62 MB/seconds]": "59",
    "[3.62 MB/seconds, 4.00 MB/seconds]": "45",
    "[4.00 MB/seconds, 4.37 MB/seconds]": "33",
    "[4.38 MB/seconds, 4.86 MB/seconds]": "25",
    "[4.87 MB/seconds, 5.27 MB/seconds]": "19",
    "[5.34 MB/seconds, 5.58 MB/seconds]": "14",
    "[5.65 MB/seconds, 6.04 MB/seconds]": "11",
    "[6.15 MB/seconds, 6.77 MB/seconds]": "8",
    "[6.81 MB/seconds, 7.31 MB/seconds]": "6",
    "[7.42 MB/seconds, 8.22 MB/seconds]": "4",
    "[8.24 MB/seconds, 8.36 MB/seconds]": "3",
    "[8.74 MB/seconds, 9.06 MB/seconds]": "3",
    "[9.82 MB/seconds, 9.91 MB/seconds]": "2",
    "[9.94 MB/seconds, 9.94 MB/seconds]": "1",
    "[10.19 MB/seconds, 10.19 MB/seconds]": "1",
    "[10.29 MB/seconds, 10.29 MB/seconds]": "1",
    "[11.43 MB/seconds, 11.43 MB/seconds]": "1",
    "[11.66 MB/seconds, 11.66 MB/seconds]": "1",
    "[11.99 MB/seconds, 11.99 MB/seconds]": "1",
    "[504.18 MB/seconds, 504.18 MB/seconds]": "1"
  },
  "totalConsumeRate": "3.64 GB/seconds",
  "totalPartitions": 10060,
  "totalProduceRate": "3.47 GB/seconds",
  "totalTopics": 1001
}

@garyparrot garyparrot self-assigned this Feb 4, 2023
@garyparrot garyparrot marked this pull request as draft February 4, 2023 12:15
@garyparrot
Copy link
Collaborator Author

目前 Performance Tool 生成的指令在執行上會有一些效能的問題

比如這個指令

--topics topic_924,topic_407,topic_129,topic_525,topic_405,topic_807,topic_124,topic_245,topic_485,topic_881,topic_644,topic_367,topic_521,topic_642,topic_247,topic_401,topic_372,topic_373,topic_252,topic_75,topic_910,topic_239,topic_911,topic_636,topic_112,topic_751,topic_359,topic_117,topic_513,topic_477,topic_240,topic_918,topic_2,topic_5,topic_307,topic_946,topic_56,topic_789,topic_943,topic_701,topic_669,topic_949,topic_387,topic_542,topic_663,topic_149,topic_545,topic_941,topic_666,topic_820,topic_425,topic_268,topic_273,topic_152,topic_54,topic_935,topic_814,topic_899,topic_415,topic_658,topic_419,topic_816,topic_893,topic_531,topic_374,topic_253,topic_375,topic_496,topic_650,topic_776,topic_535,topic_775,topic_258,topic_412,topic_260,topic_382,topic_967,topic_208,topic_34,topic_847,topic_844,topic_602,topic_328,topic_36,topic_729,topic_442,topic_289,topic_165,topic_326,topic_722,topic_447,topic_601,topic_686,topic_566,topic_291,topic_571,topic_172,topic_294,topic_173,topic_30,topic_32,topic_319,topic_957,topic_715,topic_712,topic_27,topic_277,topic_156,topic_671,topic_832,topic_433,topic_280,topic_284,topic_680,topic_681,topic_162,topic_109,topic_989,topic_747,topic_505,topic_99,topic_509,topic_903,topic_628,topic_585,topic_860,topic_344,topic_223,topic_584,topic_188,topic_468,topic_226,topic_985,topic_623,topic_986,topic_103,topic_500,topic_467,topic_193,topic_191,topic_472,topic_90,topic_470,topic_92,topic_96,topic_616,topic_977,topic_178,topic_971,topic_179,topic_333,topic_215,topic_699,topic_579,topic_731,topic_182,topic_460,topic_582,topic_184 --throttle topic_924-0:177046Byte/second,topic_924-1:52195Byte/second,topic_924-2:94509Byte/second,topic_924-3:116721Byte/second,topic_924-4:344727Byte/second,topic_924-5:43685Byte/second,topic_407-0:34860Byte/second,topic_407-1:52004Byte/second,topic_407-2:146992Byte/second,topic_407-3:215990Byte/second,topic_407-4:182314Byte/second,topic_407-5:87144Byte/second,topic_407-6:129211Byte/second,topic_129-0:312542Byte/second,topic_129-1:299890Byte/second,topic_129-2:137479Byte/second,topic_129-3:306720Byte/second,topic_129-4:362613Byte/second,topic_129-5:25455Byte/second,topic_129-6:24508Byte/second,topic_129-7:339322Byte/second,topic_129-8:338027Byte/second,topic_129-9:125042Byte/second,topic_129-10:345747Byte/second,topic_525-0:382045Byte/second,topic_525-1:49063Byte/second,topic_525-2:330351Byte/second,topic_525-3:197983Byte/second,topic_525-4:135546Byte/second,topic_525-5:115936Byte/second,topic_525-6:246612Byte/second,topic_525-7:207729Byte/second,topic_525-8:250836Byte/second,topic_525-9:88807Byte/second,topic_405-0:155712Byte/second,topic_405-1:217329Byte/second,topic_405-2:104872Byte/second,topic_405-3:34978Byte/second,topic_405-4:268724Byte/second,topic_405-5:109797Byte/second,topic_405-6:4099Byte/second,topic_405-7:118972Byte/second,topic_405-8:168072Byte/second,topic_807-0:242422Byte/second,topic_807-1:93478Byte/second,topic_807-2:534756Byte/second,topic_807-3:265221Byte/second,topic_807-4:587250Byte/second,topic_807-5:642157Byte/second,topic_807-6:375365Byte/second,topic_807-7:590428Byte/second,topic_807-8:417340Byte/second,topic_807-9:472288Byte/second,topic_807-10:56249Byte/second,topic_807-11:703130Byte/second,topic_124-0:116238Byte/second,topic_124-1:161250Byte/second,topic_124-2:229311Byte/second,topic_124-3:336753Byte/second,topic_124-4:69012Byte/second,topic_124-5:54927Byte/second,topic_124-6:80745Byte/second,topic_124-7:264867Byte/second,topic_124-8:209975Byte/second,topic_124-9:103679Byte/second,topic_124-10:276261Byte/second,topic_124-11:163950Byte/second,topic_124-12:26222Byte/second,topic_124-13:216158Byte/second,topic_245-0:266400Byte/second,topic_245-1:138587Byte/second,topic_245-2:238345Byte/second,topic_245-3:84926Byte/second,topic_245-4:112484Byte/second,topic_245-5:242339Byte/second,topic_245-6:41484Byte/second,topic_245-7:97512Byte/second,topic_245-8:17488Byte/second,topic_245-9:151006Byte/second,topic_245-10:65165Byte/second,topic_245-11:193094Byte/second,topic_245-12:283272Byte/second,topic_245-13:171105Byte/second,topic_485-0:12888Byte/second,topic_485-1:404071Byte/second,topic_485-2:220078Byte/second,topic_485-3:174777Byte/second,topic_485-4:379511Byte/second,topic_485-5:325831Byte/second,topic_485-6:239953Byte/second,topic_485-7:162733Byte/second,topic_485-8:681395Byte/second,topic_485-9:138933Byte/second,topic_881-0:94196Byte/second,topic_881-1:138591Byte/second,topic_881-2:30133Byte/second,topic_881-3:181619Byte/second,topic_881-4:88390Byte/second,topic_881-5:82785Byte/second,topic_881-6:138198Byte/second,topic_881-7:31353Byte/second,topic_881-8:144354Byte/second,topic_881-9:27491Byte/second,topic_881-10:85787Byte/second,topic_881-11:173701Byte/second,topic_881-12:11704Byte/second,topic_881-13:23233Byte/second,topic_881-14:82775Byte/second,topic_644-0:48952Byte/second,topic_644-1:62853Byte/second,topic_644-2:1215Byte/second,topic_644-3:52005Byte/second,topic_644-4:32568Byte/second,topic_644-5:2552Byte/second,topic_644-6:139848Byte/second,topic_644-7:127510Byte/second,topic_644-8:62948Byte/second,topic_644-9:133953Byte/second,topic_644-10:93012Byte/second,topic_644-11:131609Byte/second,topic_644-12:91306Byte/second,topic_644-13:63518Byte/second,topic_644-14:105191Byte/second,topic_367-0:388505Byte/second,topic_367-1:317464Byte/second,topic_367-2:411287Byte/second,topic_367-3:361845Byte/second,topic_367-4:162004Byte/second,topic_367-5:44365Byte/second,topic_367-6:1413Byte/second,topic_367-7:348745Byte/second,topic_367-8:231520Byte/second,topic_521-0:63083Byte/second,topic_521-1:44048Byte/second,topic_521-2:125879Byte/second,topic_521-3:137598Byte/second,topic_521-4:44969Byte/second,topic_521-5:194916Byte/second,topic_521-6:3254Byte/second,topic_521-7:101023Byte/second,topic_521-8:49057Byte/second,topic_521-9:58092Byte/second,topic_521-10:174182Byte/second,topic_521-11:214925Byte/second,topic_642-0:267071Byte/second,topic_642-1:355725Byte/second,topic_642-2:44654Byte/second,topic_642-3:602730Byte/second,topic_642-4:20356Byte/second,topic_642-5:210867Byte/second,topic_642-6:53564Byte/second,topic_642-7:316413Byte/second,topic_642-8:206443Byte/second,topic_642-9:70697Byte/second,topic_642-10:524191Byte/second,topic_247-0:69054Byte/second,topic_247-1:203757Byte/second,topic_247-2:42082Byte/second,topic_247-3:20331Byte/second,topic_247-4:110009Byte/second,topic_247-5:38178Byte/second,topic_247-6:28110Byte/second,topic_247-7:165948Byte/second,topic_247-8:44098Byte/second,topic_247-9:149023Byte/second,topic_247-10:139743Byte/second,topic_247-11:126730Byte/second,topic_247-12:88105Byte/second,topic_247-13:6208Byte/second,topic_401-0:125Byte/second,topic_401-1:59656Byte/second,topic_401-2:313860Byte/second,topic_401-3:91241Byte/second,topic_401-4:130703Byte/second,topic_401-5:76566Byte/second,topic_401-6:161822Byte/second,topic_401-7:288606Byte/second,topic_401-8:306460Byte/second,topic_401-9:281252Byte/second,topic_401-10:269911Byte/second,topic_401-11:232122Byte/second,topic_401-12:261338Byte/second,topic_401-13:238740Byte/second,topic_372-0:100912Byte/second,topic_372-1:130587Byte/second,topic_372-2:253688Byte/second,topic_372-3:124602Byte/second,topic_372-4:121417Byte/second,topic_372-5:187646Byte/second,topic_372-6:101975Byte/second,topic_373-0:122240Byte/second,topic_373-1:333145Byte/second,topic_373-2:11154Byte/second,topic_373-3:176418Byte/second,topic_373-4:34422Byte/second,topic_373-5:352421Byte/second,topic_252-0:34637Byte/second,topic_252-1:104619Byte/second,topic_252-2:74038Byte/second,topic_252-3:111352Byte/second,topic_252-4:70240Byte/second,topic_252-5:25673Byte/second,topic_252-6:93096Byte/second,topic_252-7:49304Byte/second,topic_252-8:139328Byte/second,topic_75-0:23512Byte/second,topic_75-1:1067985Byte/second,topic_75-2:1306941Byte/second,topic_75-3:9512Byte/second,topic_75-4:561895Byte/second,topic_75-5:646976Byte/second,topic_75-6:1240051Byte/second,topic_75-7:60422Byte/second,topic_75-8:124061Byte/second,topic_75-9:1052905Byte/second,topic_75-10:1340144Byte/second,topic_75-11:1297526Byte/second,topic_75-12:330974Byte/second,topic_910-0:66178Byte/second,topic_910-1:38364Byte/second,topic_910-2:24031Byte/second,topic_910-3:13800Byte/second,topic_910-4:146366Byte/second,topic_910-5:89621Byte/second,topic_910-6:45698Byte/second,topic_910-7:141720Byte/second,topic_910-8:156000Byte/second,topic_910-9:163102Byte/second,topic_910-10:58830Byte/second,topic_910-11:88945Byte/second,topic_239-0:110515Byte/second,topic_239-1:1382606Byte/second,topic_239-2:155556Byte/second,topic_239-3:376309Byte/second,topic_239-4:348464Byte/second,topic_239-5:563123Byte/second,topic_239-6:277177Byte/second,topic_239-7:109091Byte/second,topic_239-8:563742Byte/second,topic_911-0:451423Byte/second,topic_911-1:248697Byte/second,topic_911-2:582552Byte/second,topic_911-3:451234Byte/second,topic_911-4:153766Byte/second,topic_636-0:1268637Byte/second,topic_636-1:168658Byte/second,topic_636-2:951041Byte/second,topic_636-3:1832901Byte/second,topic_636-4:956816Byte/second,topic_112-0:364627Byte/second,topic_112-1:374488Byte/second,topic_112-2:382103Byte/second,topic_112-3:434000Byte/second,topic_112-4:177360Byte/second,topic_112-5:440414Byte/second,topic_112-6:435200Byte/second,topic_112-7:12187Byte/second,topic_112-8:290132Byte/second,topic_112-9:338357Byte/second,topic_112-10:64925Byte/second,topic_112-11:242411Byte/second,topic_112-12:119839Byte/second,topic_751-0:322223Byte/second,topic_751-1:145031Byte/second,topic_751-2:33048Byte/second,topic_751-3:177359Byte/second,topic_751-4:51136Byte/second,topic_751-5:178508Byte/second,topic_751-6:205017Byte/second,topic_751-7:70334Byte/second,topic_751-8:288987Byte/second,topic_751-9:218716Byte/second,topic_751-10:258045Byte/second,topic_751-11:245370Byte/second,topic_751-12:27875Byte/second,topic_751-13:228113Byte/second,topic_751-14:116787Byte/second,topic_359-0:223337Byte/second,topic_359-1:637942Byte/second,topic_359-2:796200Byte/second,topic_359-3:530372Byte/second,topic_359-4:720474Byte/second,topic_359-5:225770Byte/second,topic_359-6:8271Byte/second,topic_359-7:271685Byte/second,topic_359-8:134255Byte/second,topic_359-9:36106Byte/second,topic_117-0:88820Byte/second,topic_117-1:47809Byte/second,topic_117-2:89558Byte/second,topic_117-3:72808Byte/second,topic_117-4:99939Byte/second,topic_117-5:100512Byte/second,topic_117-6:99731Byte/second,topic_117-7:47844Byte/second,topic_117-8:93989Byte/second,topic_117-9:63282Byte/second,topic_117-10:6513Byte/second,topic_117-11:28053Byte/second,topic_513-0:196891Byte/second,topic_513-1:279286Byte/second,topic_513-2:380318Byte/second,topic_513-3:402006Byte/second,topic_513-4:474407Byte/second,topic_513-5:352440Byte/second,topic_513-6:297852Byte/second,topic_513-7:103004Byte/second,topic_513-8:120670Byte/second,topic_513-9:274978Byte/second,topic_513-10:83129Byte/second,topic_513-11:67771Byte/second,topic_513-12:511508Byte/second,topic_477-0:276538Byte/second,topic_477-1:367201Byte/second,topic_477-2:377720Byte/second,topic_477-3:258006Byte/second,topic_477-4:528769Byte/second,topic_477-5:528880Byte/second,topic_240-0:405364Byte/second,topic_240-1:547919Byte/second,topic_240-2:630149Byte/second,topic_240-3:103129Byte/second,topic_240-4:140804Byte/second,topic_240-5:276924Byte/second,topic_918-0:480927Byte/second,topic_918-1:50192Byte/second,topic_918-2:742989Byte/second,topic_918-3:435828Byte/second,topic_918-4:802852Byte/second,topic_2-0:56907Byte/second,topic_2-1:42682Byte/second,topic_2-2:334198Byte/second,topic_2-3:283440Byte/second,topic_2-4:82684Byte/second,topic_2-5:165852Byte/second,topic_2-6:303078Byte/second,topic_2-7:216884Byte/second,topic_2-8:335754Byte/second,topic_2-9:44621Byte/second,topic_5-0:200170Byte/second,topic_5-1:33906Byte/second,topic_5-2:274081Byte/second,topic_5-3:105217Byte/second,topic_5-4:236436Byte/second,topic_5-5:47589Byte/second,topic_5-6:251124Byte/second,topic_5-7:268516Byte/second,topic_5-8:10201Byte/second,topic_5-9:281187Byte/second,topic_5-10:241231Byte/second,topic_5-11:159043Byte/second,topic_5-12:98978Byte/second,topic_307-0:153244Byte/second,topic_307-1:351286Byte/second,topic_307-2:437822Byte/second,topic_307-3:15027Byte/second,topic_307-4:219310Byte/second,topic_307-5:335063Byte/second,topic_307-6:229900Byte/second,topic_307-7:135007Byte/second,topic_307-8:129848Byte/second,topic_307-9:190424Byte/second,topic_946-0:297899Byte/second,topic_946-1:89593Byte/second,topic_946-2:67680Byte/second,topic_946-3:99366Byte/second,topic_946-4:11423Byte/second,topic_946-5:22440Byte/second,topic_946-6:317374Byte/second,topic_946-7:150539Byte/second,topic_946-8:146685Byte/second,topic_56-0:951135Byte/second,topic_56-1:352965Byte/second,topic_56-2:399311Byte/second,topic_56-3:741772Byte/second,topic_56-4:44512Byte/second,topic_56-5:488Byte/second,topic_789-0:744868Byte/second,topic_789-1:1088936Byte/second,topic_789-2:110268Byte/second,topic_789-3:897095Byte/second,topic_789-4:961118Byte/second,topic_789-5:326910Byte/second,topic_789-6:108012Byte/second,topic_789-7:1053599Byte/second,topic_789-8:907865Byte/second,topic_943-0:93402Byte/second,topic_943-1:71006Byte/second,topic_943-2:1073Byte/second,topic_943-3:62732Byte/second,topic_943-4:9509Byte/second,topic_943-5:80493Byte/second,topic_943-6:106613Byte/second,topic_943-7:94875Byte/second,topic_943-8:29376Byte/second,topic_943-9:112179Byte/second,topic_943-10:34343Byte/second,topic_943-11:64597Byte/second,topic_943-12:55030Byte/second,topic_701-0:220458Byte/second,topic_701-1:324479Byte/second,topic_701-2:193257Byte/second,topic_701-3:337460Byte/second,topic_701-4:152981Byte/second,topic_701-5:286368Byte/second,topic_701-6:358587Byte/second,topic_701-7:391164Byte/second,topic_701-8:70600Byte/second,topic_701-9:311462Byte/second,topic_701-10:197013Byte/second,topic_701-11:3642Byte/second,topic_701-12:140047Byte/second,topic_669-0:57892Byte/second,topic_669-1:212102Byte/second,topic_669-2:96303Byte/second,topic_669-3:83610Byte/second,topic_669-4:77067Byte/second,topic_669-5:109243Byte/second,topic_669-6:152357Byte/second,topic_949-0:198367Byte/second,topic_949-1:37468Byte/second,topic_949-2:66250Byte/second,topic_949-3:74655Byte/second,topic_949-4:106248Byte/second,topic_949-5:164807Byte/second,topic_949-6:94860Byte/second,topic_949-7:78911Byte/second,topic_949-8:171618Byte/second,topic_949-9:16001Byte/second,topic_949-10:193488Byte/second,topic_387-0:179001Byte/second,topic_387-1:68236Byte/second,topic_387-2:81633Byte/second,topic_387-3:37730Byte/second,topic_387-4:25256Byte/second,topic_387-5:97256Byte/second,topic_387-6:151487Byte/second,topic_387-7:32145Byte/second,topic_387-8:104695Byte/second,topic_387-9:185418Byte/second,topic_387-10:120598Byte/second,topic_387-11:207067Byte/second,topic_387-12:121796Byte/second,topic_387-13:166695Byte/second,topic_542-0:1087230Byte/second,topic_542-1:28475Byte/second,topic_542-2:349154Byte/second,topic_542-3:236456Byte/second,topic_542-4:267196Byte/second,topic_542-5:686919Byte/second,topic_542-6:428606Byte/second,topic_542-7:1248642Byte/second,topic_542-8:356259Byte/second,topic_542-9:1409817Byte/second,topic_542-10:918980Byte/second,topic_542-11:497883Byte/second,topic_542-12:821732Byte/second,topic_542-13:533071Byte/second,topic_542-14:1067843Byte/second,topic_663-0:1066583Byte/second,topic_663-1:701371Byte/second,topic_663-2:1079246Byte/second,topic_663-3:149193Byte/second,topic_663-4:197000Byte/second,topic_663-5:1042386Byte/second,topic_149-0:672180Byte/second,topic_149-1:643422Byte/second,topic_149-2:336138Byte/second,topic_149-3:698457Byte/second,topic_149-4:557216Byte/second,topic_149-5:316605Byte/second,topic_149-6:373306Byte/second,topic_149-7:574854Byte/second,topic_545-0:211578Byte/second,topic_545-1:316296Byte/second,topic_545-2:138716Byte/second,topic_545-3:247280Byte/second,topic_545-4:240902Byte/second,topic_545-5:155380Byte/second,topic_545-6:265277Byte/second,topic_545-7:75460Byte/second,topic_545-8:317791Byte/second,topic_545-9:18273Byte/second,topic_545-10:151631Byte/second,topic_545-11:87034Byte/second,topic_545-12:165134Byte/second,topic_941-0:71673Byte/second,topic_941-1:40564Byte/second,topic_941-2:101897Byte/second,topic_941-3:99730Byte/second,topic_941-4:130946Byte/second,topic_941-5:39928Byte/second,topic_941-6:99665Byte/second,topic_941-7:124544Byte/second,topic_941-8:109415Byte/second,topic_666-0:220267Byte/second,topic_666-1:84889Byte/second,topic_666-2:5792Byte/second,topic_666-3:123382Byte/second,topic_666-4:166618Byte/second,topic_666-5:191320Byte/second,topic_666-6:56759Byte/second,topic_666-7:226326Byte/second,topic_666-8:122802Byte/second,topic_820-0:142860Byte/second,topic_820-1:84850Byte/second,topic_820-2:47950Byte/second,topic_820-3:115591Byte/second,topic_820-4:169751Byte/second,topic_820-5:191660Byte/second,topic_820-6:122502Byte/second,topic_820-7:155674Byte/second,topic_820-8:21087Byte/second,topic_820-9:117087Byte/second,topic_820-10:44090Byte/second,topic_425-0:918260Byte/second,topic_425-1:808463Byte/second,topic_425-2:314283Byte/second,topic_425-3:876921Byte/second,topic_425-4:1261985Byte/second,topic_425-5:640080Byte/second,topic_425-6:457957Byte/second,topic_425-7:266711Byte/second,topic_425-8:955391Byte/second,topic_425-9:116194Byte/second,topic_425-10:1180354Byte/second,topic_425-11:385725Byte/second,topic_425-12:160434Byte/second,topic_425-13:615108Byte/second,topic_268-0:223244Byte/second,topic_268-1:32063Byte/second,topic_268-2:237335Byte/second,topic_268-3:231930Byte/second,topic_268-4:195088Byte/second,topic_268-5:235831Byte/second,topic_268-6:253062Byte/second,topic_268-7:19614Byte/second,topic_268-8:145431Byte/second,topic_268-9:184642Byte/second,topic_268-10:93595Byte/second,topic_268-11:149042Byte/second,topic_268-12:145305Byte/second,topic_273-0:137952Byte/second,topic_273-1:87655Byte/second,topic_273-2:168338Byte/second,topic_273-3:48560Byte/second,topic_273-4:173680Byte/second,topic_273-5:134243Byte/second,topic_273-6:18554Byte/second,topic_273-7:186920Byte/second,topic_273-8:184101Byte/second,topic_273-9:7207Byte/second,topic_273-10:24616Byte/second,topic_273-11:171770Byte/second,topic_273-12:140261Byte/second,topic_273-13:142318Byte/second,topic_273-14:163699Byte/second,topic_152-0:236002Byte/second,topic_152-1:364190Byte/second,topic_152-2:468258Byte/second,topic_152-3:339993Byte/second,topic_152-4:527672Byte/second,topic_152-5:161105Byte/second,topic_152-6:635952Byte/second,topic_152-7:741438Byte/second,topic_152-8:773965Byte/second,topic_152-9:127477Byte/second,topic_54-0:189846Byte/second,topic_54-1:108580Byte/second,topic_54-2:233747Byte/second,topic_54-3:226597Byte/second,topic_54-4:333137Byte/second,topic_54-5:50960Byte/second,topic_54-6:197681Byte/second,topic_54-7:5397Byte/second,topic_54-8:342128Byte/second,topic_54-9:117144Byte/second,topic_54-10:308865Byte/second,topic_54-11:33761Byte/second,topic_935-0:509108Byte/second,topic_935-1:647321Byte/second,topic_935-2:912382Byte/second,topic_935-3:781019Byte/second,topic_935-4:914349Byte/second,topic_814-0:193180Byte/second,topic_814-1:161639Byte/second,topic_814-2:72132Byte/second,topic_814-3:44914Byte/second,topic_814-4:116496Byte/second,topic_814-5:262064Byte/second,topic_814-6:310642Byte/second,topic_814-7:21748Byte/second,topic_814-8:273831Byte/second,topic_814-9:324607Byte/second,topic_814-10:325994Byte/second,topic_814-11:340379Byte/second,topic_814-12:169486Byte/second,topic_899-0:51148Byte/second,topic_899-1:21915Byte/second,topic_899-2:139384Byte/second,topic_899-3:65363Byte/second,topic_899-4:271027Byte/second,topic_899-5:305643Byte/second,topic_899-6:358289Byte/second,topic_899-7:186313Byte/second,topic_899-8:73255Byte/second,topic_899-9:175701Byte/second,topic_899-10:81829Byte/second,topic_899-11:164249Byte/second,topic_899-12:175929Byte/second,topic_415-0:131485Byte/second,topic_415-1:40371Byte/second,topic_415-2:31351Byte/second,topic_415-3:3313Byte/second,topic_415-4:47585Byte/second,topic_415-5:31497Byte/second,topic_415-6:875Byte/second,topic_415-7:105911Byte/second,topic_415-8:5924Byte/second,topic_415-9:120797Byte/second,topic_415-10:116046Byte/second,topic_415-11:118139Byte/second,topic_415-12:3757Byte/second,topic_415-13:6519Byte/second,topic_658-0:125716Byte/second,topic_658-1:61711Byte/second,topic_658-2:180348Byte/second,topic_658-3:25377Byte/second,topic_658-4:336139Byte/second,topic_419-0:57497Byte/second,topic_419-1:377319Byte/second,topic_419-2:494707Byte/second,topic_419-3:21716Byte/second,topic_419-4:143182Byte/second,topic_419-5:251757Byte/second,topic_419-6:218990Byte/second,topic_419-7:308473Byte/second,topic_419-8:60137Byte/second,topic_419-9:183194Byte/second,topic_419-10:71329Byte/second,topic_816-0:68469Byte/second,topic_816-1:10180Byte/second,topic_816-2:100808Byte/second,topic_816-3:119274Byte/second,topic_816-4:18667Byte/second,topic_816-5:67934Byte/second,topic_816-6:63842Byte/second,topic_816-7:17165Byte/second,topic_816-8:4790Byte/second,topic_816-9:71925Byte/second,topic_816-10:131087Byte/second,topic_816-11:11601Byte/second,topic_816-12:64927Byte/second,topic_893-0:103142Byte/second,topic_893-1:210054Byte/second,topic_893-2:443211Byte/second,topic_893-3:265491Byte/second,topic_893-4:226081Byte/second,topic_893-5:464062Byte/second,topic_893-6:452325Byte/second,topic_893-7:112801Byte/second,topic_531-0:130656Byte/second,topic_531-1:364180Byte/second,topic_531-2:98382Byte/second,topic_531-3:221169Byte/second,topic_531-4:398962Byte/second,topic_531-5:312551Byte/second,topic_531-6:309084Byte/second,topic_531-7:287524Byte/second,topic_374-0:52096Byte/second,topic_374-1:8605Byte/second,topic_374-2:36398Byte/second,topic_374-3:100335Byte/second,topic_374-4:35761Byte/second,topic_374-5:22823Byte/second,topic_374-6:83034Byte/second,topic_374-7:11875Byte/second,topic_374-8:96096Byte/second,topic_374-9:96815Byte/second,topic_374-10:98793Byte/second,topic_374-11:28034Byte/second,topic_374-12:2336Byte/second,topic_253-0:20448Byte/second,topic_253-1:268780Byte/second,topic_253-2:20096Byte/second,topic_253-3:64575Byte/second,topic_253-4:270785Byte/second,topic_253-5:22272Byte/second,topic_253-6:237068Byte/second,topic_253-7:219725Byte/second,topic_253-8:411092Byte/second,topic_375-0:45666Byte/second,topic_375-1:52349Byte/second,topic_375-2:84339Byte/second,topic_375-3:18044Byte/second,topic_375-4:9649Byte/second,topic_375-5:106951Byte/second,topic_375-6:89350Byte/second,topic_375-7:40208Byte/second,topic_375-8:54007Byte/second,topic_375-9:86524Byte/second,topic_375-10:9293Byte/second,topic_375-11:72658Byte/second,topic_375-12:11604Byte/second,topic_375-13:79252Byte/second,topic_375-14:102381Byte/second,topic_496-0:292086Byte/second,topic_496-1:207173Byte/second,topic_496-2:16732Byte/second,topic_496-3:255324Byte/second,topic_496-4:70774Byte/second,topic_496-5:261019Byte/second,topic_496-6:12377Byte/second,topic_496-7:521969Byte/second,topic_496-8:218947Byte/second,topic_496-9:82738Byte/second,topic_496-10:215843Byte/second,topic_496-11:70474Byte/second,topic_650-0:101743Byte/second,topic_650-1:7866Byte/second,topic_650-2:251844Byte/second,topic_650-3:261936Byte/second,topic_650-4:288135Byte/second,topic_650-5:40115Byte/second,topic_650-6:207357Byte/second,topic_650-7:180496Byte/second,topic_650-8:251149Byte/second,topic_650-9:352368Byte/second,topic_650-10:61787Byte/second,topic_650-11:205336Byte/second,topic_776-0:241637Byte/second,topic_776-1:118813Byte/second,topic_776-2:190124Byte/second,topic_776-3:244657Byte/second,topic_776-4:41695Byte/second,topic_776-5:92813Byte/second,topic_776-6:90159Byte/second,topic_776-7:83858Byte/second,topic_776-8:143451Byte/second,topic_776-9:96191Byte/second,topic_776-10:121997Byte/second,topic_776-11:239709Byte/second,topic_776-12:174421Byte/second,topic_776-13:208715Byte/second,topic_776-14:226938Byte/second,topic_535-0:140657Byte/second,topic_535-1:241999Byte/second,topic_535-2:177744Byte/second,topic_535-3:96171Byte/second,topic_535-4:83060Byte/second,topic_535-5:22985Byte/second,topic_535-6:235866Byte/second,topic_775-0:347547Byte/second,topic_775-1:42709Byte/second,topic_775-2:136748Byte/second,topic_775-3:159696Byte/second,topic_775-4:283714Byte/second,topic_775-5:283537Byte/second,topic_775-6:153240Byte/second,topic_775-7:168719Byte/second,topic_775-8:256023Byte/second,topic_775-9:283932Byte/second,topic_258-0:89902Byte/second,topic_258-1:119904Byte/second,topic_258-2:104486Byte/second,topic_258-3:58190Byte/second,topic_258-4:103910Byte/second,topic_258-5:112844Byte/second,topic_258-6:91179Byte/second,topic_258-7:88731Byte/second,topic_258-8:112752Byte/second,topic_258-9:47619Byte/second,topic_258-10:15293Byte/second,topic_258-11:29108Byte/second,topic_258-12:66302Byte/second,topic_258-13:91926Byte/second,topic_412-0:496259Byte/second,topic_412-1:151298Byte/second,topic_412-2:428047Byte/second,topic_412-3:444956Byte/second,topic_412-4:73780Byte/second,topic_412-5:399211Byte/second,topic_412-6:415035Byte/second,topic_412-7:195768Byte/second,topic_412-8:93505Byte/second,topic_260-0:67810Byte/second,topic_260-1:60622Byte/second,topic_260-2:114678Byte/second,topic_260-3:11454Byte/second,topic_260-4:67647Byte/second,topic_260-5:103704Byte/second,topic_260-6:115404Byte/second,topic_260-7:118250Byte/second,topic_260-8:140233Byte/second,topic_382-0:489147Byte/second,topic_382-1:684318Byte/second,topic_382-2:188921Byte/second,topic_382-3:964375Byte/second,topic_382-4:475592Byte/second,topic_967-0:366241Byte/second,topic_967-1:311879Byte/second,topic_967-2:119674Byte/second,topic_967-3:70838Byte/second,topic_967-4:175234Byte/second,topic_967-5:399943Byte/second,topic_967-6:401824Byte/second,topic_967-7:142844Byte/second,topic_967-8:108105Byte/second,topic_208-0:180680Byte/second,topic_208-1:554511Byte/second,topic_208-2:193851Byte/second,topic_208-3:460594Byte/second,topic_208-4:343172Byte/second,topic_208-5:383170Byte/second,topic_208-6:525270Byte/second,topic_208-7:247406Byte/second,topic_208-8:284757Byte/second,topic_208-9:139837Byte/second,topic_208-10:123178Byte/second,topic_208-11:338552Byte/second,topic_208-12:167943Byte/second,topic_34-0:899204Byte/second,topic_34-1:498822Byte/second,topic_34-2:44112Byte/second,topic_34-3:79406Byte/second,topic_34-4:671065Byte/second,topic_847-0:293720Byte/second,topic_847-1:278001Byte/second,topic_847-2:362577Byte/second,topic_847-3:96155Byte/second,topic_847-4:18803Byte/second,topic_847-5:39996Byte/second,topic_847-6:30150Byte/second,topic_847-7:56164Byte/second,topic_847-8:350879Byte/second,topic_847-9:20021Byte/second,topic_847-10:182085Byte/second,topic_847-11:109925Byte/second,topic_847-12:279959Byte/second,topic_847-13:4990Byte/second,topic_844-0:917732Byte/second,topic_844-1:772810Byte/second,topic_844-2:591135Byte/second,topic_844-3:24914Byte/second,topic_844-4:837664Byte/second,topic_602-0:6267Byte/second,topic_602-1:40891Byte/second,topic_602-2:293420Byte/second,topic_602-3:81205Byte/second,topic_602-4:119230Byte/second,topic_602-5:253168Byte/second,topic_602-6:172818Byte/second,topic_602-7:445022Byte/second,topic_602-8:67819Byte/second,topic_602-9:356186Byte/second,topic_328-0:91604Byte/second,topic_328-1:101058Byte/second,topic_328-2:110928Byte/second,topic_328-3:112165Byte/second,topic_328-4:97498Byte/second,topic_328-5:85399Byte/second,topic_328-6:57680Byte/second,topic_328-7:28263Byte/second,topic_328-8:96010Byte/second,topic_328-9:68842Byte/second,topic_328-10:85010Byte/second,topic_328-11:75826Byte/second,topic_328-12:38143Byte/second,topic_328-13:58746Byte/second,topic_36-0:767865Byte/second,topic_36-1:646103Byte/second,topic_36-2:207440Byte/second,topic_36-3:75494Byte/second,topic_36-4:492012Byte/second,topic_36-5:442911Byte/second,topic_36-6:169468Byte/second,topic_36-7:487242Byte/second,topic_36-8:466150Byte/second,topic_36-9:9858Byte/second,topic_36-10:280977Byte/second,topic_36-11:628024Byte/second,topic_36-12:209710Byte/second,topic_36-13:200046Byte/second,topic_36-14:118818Byte/second,topic_729-0:239159Byte/second,topic_729-1:229568Byte/second,topic_729-2:233639Byte/second,topic_729-3:93589Byte/second,topic_729-4:170668Byte/second,topic_729-5:286322Byte/second,topic_729-6:154340Byte/second,topic_729-7:81463Byte/second,topic_729-8:268066Byte/second,topic_442-0:16752Byte/second,topic_442-1:437700Byte/second,topic_442-2:470222Byte/second,topic_442-3:239950Byte/second,topic_442-4:59440Byte/second,topic_442-5:328362Byte/second,topic_289-0:640199Byte/second,topic_289-1:9572Byte/second,topic_289-2:734171Byte/second,topic_289-3:58790Byte/second,topic_289-4:659148Byte/second,topic_165-0:75597Byte/second,topic_165-1:131494Byte/second,topic_165-2:86449Byte/second,topic_165-3:118696Byte/second,topic_165-4:62257Byte/second,topic_165-5:67946Byte/second,topic_165-6:114199Byte/second,topic_165-7:52827Byte/second,topic_165-8:121817Byte/second,topic_165-9:161741Byte/second,topic_165-10:150546Byte/second,topic_326-0:184067Byte/second,topic_326-1:190223Byte/second,topic_326-2:219185Byte/second,topic_326-3:10254Byte/second,topic_326-4:12657Byte/second,topic_326-5:393053Byte/second,topic_326-6:182687Byte/second,topic_326-7:407485Byte/second,topic_326-8:90087Byte/second,topic_326-9:369828Byte/second,topic_326-10:300232Byte/second,topic_326-11:217430Byte/second,topic_326-12:138166Byte/second,topic_326-13:237356Byte/second,topic_326-14:207646Byte/second,topic_722-0:121108Byte/second,topic_722-1:228182Byte/second,topic_722-2:128608Byte/second,topic_722-3:91226Byte/second,topic_722-4:45952Byte/second,topic_722-5:16649Byte/second,topic_722-6:74890Byte/second,topic_722-7:110962Byte/second,topic_722-8:121406Byte/second,topic_722-9:42718Byte/second,topic_722-10:198437Byte/second,topic_722-11:112670Byte/second,topic_722-12:216267Byte/second,topic_722-13:126634Byte/second,topic_447-0:202543Byte/second,topic_447-1:280900Byte/second,topic_447-2:47581Byte/second,topic_447-3:188925Byte/second,topic_447-4:47306Byte/second,topic_447-5:283671Byte/second,topic_447-6:80671Byte/second,topic_601-0:650988Byte/second,topic_601-1:551723Byte/second,topic_601-2:2030508Byte/second,topic_601-3:2008762Byte/second,topic_601-4:186904Byte/second,topic_686-0:216462Byte/second,topic_686-1:228230Byte/second,topic_686-2:112330Byte/second,topic_686-3:235872Byte/second,topic_686-4:68986Byte/second,topic_686-5:189905Byte/second,topic_566-0:932094Byte/second,topic_566-1:597836Byte/second,topic_566-2:865752Byte/second,topic_566-3:396519Byte/second,topic_566-4:284102Byte/second,topic_566-5:741016Byte/second,topic_291-0:23551Byte/second,topic_291-1:128737Byte/second,topic_291-2:207895Byte/second,topic_291-3:161477Byte/second,topic_291-4:171005Byte/second,topic_291-5:75480Byte/second,topic_291-6:28388Byte/second,topic_291-7:165730Byte/second,topic_291-8:204837Byte/second,topic_291-9:167006Byte/second,topic_291-10:171495Byte/second,topic_291-11:146027Byte/second,topic_291-12:150999Byte/second,topic_291-13:76338Byte/second,topic_291-14:216500Byte/second,topic_571-0:201967Byte/second,topic_571-1:38192Byte/second,topic_571-2:119502Byte/second,topic_571-3:161791Byte/second,topic_571-4:101760Byte/second,topic_571-5:66959Byte/second,topic_571-6:54353Byte/second,topic_571-7:22148Byte/second,topic_172-0:371427Byte/second,topic_172-1:299042Byte/second,topic_172-2:133400Byte/second,topic_172-3:236157Byte/second,topic_172-4:302798Byte/second,topic_172-5:478586Byte/second,topic_172-6:279183Byte/second,topic_294-0:10185Byte/second,topic_294-1:18965Byte/second,topic_294-2:17213Byte/second,topic_294-3:195640Byte/second,topic_294-4:191779Byte/second,topic_294-5:187312Byte/second,topic_294-6:76015Byte/second,topic_294-7:48996Byte/second,topic_294-8:23082Byte/second,topic_294-9:141019Byte/second,topic_294-10:129103Byte/second,topic_294-11:163231Byte/second,topic_294-12:142648Byte/second,topic_173-0:133554Byte/second,topic_173-1:51891Byte/second,topic_173-2:103543Byte/second,topic_173-3:9718Byte/second,topic_173-4:26460Byte/second,topic_173-5:187518Byte/second,topic_173-6:116256Byte/second,topic_173-7:3572Byte/second,topic_173-8:136186Byte/second,topic_30-0:12692Byte/second,topic_30-1:91386Byte/second,topic_30-2:15824Byte/second,topic_30-3:82616Byte/second,topic_30-4:62985Byte/second,topic_30-5:76791Byte/second,topic_30-6:11850Byte/second,topic_30-7:75082Byte/second,topic_30-8:52649Byte/second,topic_30-9:91276Byte/second,topic_30-10:51615Byte/second,topic_30-11:88231Byte/second,topic_32-0:218117Byte/second,topic_32-1:368670Byte/second,topic_32-2:159082Byte/second,topic_32-3:76596Byte/second,topic_32-4:40375Byte/second,topic_32-5:268339Byte/second,topic_32-6:256789Byte/second,topic_32-7:325480Byte/second,topic_32-8:45727Byte/second,topic_32-9:150208Byte/second,topic_32-10:254030Byte/second,topic_32-11:47122Byte/second,topic_319-0:87460Byte/second,topic_319-1:64154Byte/second,topic_319-2:55955Byte/second,topic_319-3:71918Byte/second,topic_319-4:19473Byte/second,topic_319-5:54382Byte/second,topic_319-6:80834Byte/second,topic_319-7:88856Byte/second,topic_319-8:108139Byte/second,topic_319-9:32784Byte/second,topic_319-10:87364Byte/second,topic_319-11:3999Byte/second,topic_319-12:53713Byte/second,topic_957-0:323656Byte/second,topic_957-1:135200Byte/second,topic_957-2:532749Byte/second,topic_957-3:467175Byte/second,topic_957-4:367635Byte/second,topic_957-5:458745Byte/second,topic_957-6:857207Byte/second,topic_715-0:121984Byte/second,topic_715-1:8308Byte/second,topic_715-2:119236Byte/second,topic_715-3:49208Byte/second,topic_715-4:131567Byte/second,topic_715-5:52189Byte/second,topic_715-6:140537Byte/second,topic_715-7:40855Byte/second,topic_715-8:114742Byte/second,topic_715-9:16100Byte/second,topic_715-10:106351Byte/second,topic_715-11:80269Byte/second,topic_715-12:138976Byte/second,topic_715-13:38499Byte/second,topic_715-14:51959Byte/second,topic_712-0:413710Byte/second,topic_712-1:269666Byte/second,topic_712-2:420863Byte/second,topic_712-3:195159Byte/second,topic_712-4:81287Byte/second,topic_712-5:253375Byte/second,topic_712-6:413297Byte/second,topic_712-7:344259Byte/second,topic_712-8:351172Byte/second,topic_712-9:70864Byte/second,topic_712-10:54214Byte/second,topic_27-0:706535Byte/second,topic_27-1:169445Byte/second,topic_27-2:77421Byte/second,topic_27-3:716734Byte/second,topic_27-4:10198Byte/second,topic_27-5:44552Byte/second,topic_27-6:347830Byte/second,topic_277-0:12265Byte/second,topic_277-1:94160Byte/second,topic_277-2:95768Byte/second,topic_277-3:84179Byte/second,topic_277-4:142115Byte/second,topic_277-5:145508Byte/second,topic_277-6:119566Byte/second,topic_277-7:137167Byte/second,topic_277-8:109177Byte/second,topic_277-9:97856Byte/second,topic_277-10:166417Byte/second,topic_277-11:64100Byte/second,topic_277-12:34541Byte/second,topic_277-13:138973Byte/second,topic_156-0:102308Byte/second,topic_156-1:59282Byte/second,topic_156-2:64637Byte/second,topic_156-3:60839Byte/second,topic_156-4:107957Byte/second,topic_156-5:115295Byte/second,topic_156-6:49543Byte/second,topic_156-7:4988Byte/second,topic_156-8:108428Byte/second,topic_671-0:343496Byte/second,topic_671-1:88614Byte/second,topic_671-2:750523Byte/second,topic_671-3:44771Byte/second,topic_671-4:242863Byte/second,topic_671-5:878074Byte/second,topic_671-6:223896Byte/second,topic_671-7:497491Byte/second,topic_671-8:527861Byte/second,topic_671-9:169083Byte/second,topic_671-10:1013012Byte/second,topic_832-0:275331Byte/second,topic_832-1:350411Byte/second,topic_832-2:564946Byte/second,topic_832-3:29491Byte/second,topic_832-4:347648Byte/second,topic_832-5:148488Byte/second,topic_832-6:530310Byte/second,topic_832-7:524859Byte/second,topic_832-8:124436Byte/second,topic_433-0:601251Byte/second,topic_433-1:661892Byte/second,topic_433-2:155831Byte/second,topic_433-3:541473Byte/second,topic_433-4:644142Byte/second,topic_433-5:532514Byte/second,topic_433-6:476696Byte/second,topic_433-7:21643Byte/second,topic_433-8:195589Byte/second,topic_280-0:251444Byte/second,topic_280-1:95070Byte/second,topic_280-2:487065Byte/second,topic_280-3:223180Byte/second,topic_280-4:207141Byte/second,topic_280-5:236803Byte/second,topic_280-6:3198Byte/second,topic_284-0:127262Byte/second,topic_284-1:163091Byte/second,topic_284-2:114294Byte/second,topic_284-3:6844Byte/second,topic_284-4:33099Byte/second,topic_284-5:31550Byte/second,topic_284-6:8420Byte/second,topic_284-7:137355Byte/second,topic_284-8:113193Byte/second,topic_284-9:8733Byte/second,topic_284-10:5811Byte/second,topic_680-0:106491Byte/second,topic_680-1:37720Byte/second,topic_680-2:120333Byte/second,topic_680-3:80522Byte/second,topic_680-4:38208Byte/second,topic_680-5:60991Byte/second,topic_680-6:110402Byte/second,topic_680-7:176900Byte/second,topic_680-8:39835Byte/second,topic_680-9:33014Byte/second,topic_680-10:98384Byte/second,topic_680-11:117635Byte/second,topic_680-12:46740Byte/second,topic_681-0:217756Byte/second,topic_681-1:193096Byte/second,topic_681-2:269733Byte/second,topic_681-3:64265Byte/second,topic_681-4:253638Byte/second,topic_681-5:260187Byte/second,topic_681-6:53672Byte/second,topic_681-7:118426Byte/second,topic_681-8:254007Byte/second,topic_681-9:230788Byte/second,topic_681-10:19618Byte/second,topic_162-0:310018Byte/second,topic_162-1:235066Byte/second,topic_162-2:85246Byte/second,topic_162-3:114913Byte/second,topic_162-4:172623Byte/second,topic_162-5:216495Byte/second,topic_162-6:187584Byte/second,topic_162-7:154731Byte/second,topic_162-8:124355Byte/second,topic_162-9:162617Byte/second,topic_162-10:40730Byte/second,topic_162-11:85764Byte/second,topic_162-12:6322Byte/second,topic_162-13:235833Byte/second,topic_162-14:131258Byte/second,topic_109-0:286097Byte/second,topic_109-1:258334Byte/second,topic_109-2:404807Byte/second,topic_109-3:35168Byte/second,topic_109-4:53086Byte/second,topic_109-5:289166Byte/second,topic_109-6:179451Byte/second,topic_109-7:119875Byte/second,topic_109-8:359437Byte/second,topic_109-9:139842Byte/second,topic_109-10:410833Byte/second,topic_989-0:738346Byte/second,topic_989-1:228115Byte/second,topic_989-2:653185Byte/second,topic_989-3:785008Byte/second,topic_989-4:274468Byte/second,topic_747-0:399970Byte/second,topic_747-1:96611Byte/second,topic_747-2:70222Byte/second,topic_747-3:547895Byte/second,topic_747-4:1398833Byte/second,topic_747-5:670572Byte/second,topic_505-0:37947Byte/second,topic_505-1:119022Byte/second,topic_505-2:122206Byte/second,topic_505-3:61656Byte/second,topic_505-4:42965Byte/second,topic_505-5:123601Byte/second,topic_505-6:121924Byte/second,topic_505-7:85246Byte/second,topic_505-8:17908Byte/second,topic_505-9:41977Byte/second,topic_505-10:131257Byte/second,topic_505-11:101632Byte/second,topic_505-12:3002Byte/second,topic_99-0:208223Byte/second,topic_99-1:434582Byte/second,topic_99-2:288987Byte/second,topic_99-3:354441Byte/second,topic_99-4:230818Byte/second,topic_99-5:131541Byte/second,topic_99-6:415896Byte/second,topic_99-7:307201Byte/second,topic_99-8:292097Byte/second,topic_509-0:267496Byte/second,topic_509-1:76574Byte/second,topic_509-2:17947Byte/second,topic_509-3:91713Byte/second,topic_509-4:234344Byte/second,topic_509-5:58849Byte/second,topic_509-6:19692Byte/second,topic_509-7:135787Byte/second,topic_509-8:211182Byte/second,topic_903-0:150991Byte/second,topic_903-1:405580Byte/second,topic_903-2:108697Byte/second,topic_903-3:124320Byte/second,topic_903-4:346354Byte/second,topic_903-5:66424Byte/second,topic_628-0:83091Byte/second,topic_628-1:114629Byte/second,topic_628-2:40860Byte/second,topic_628-3:79722Byte/second,topic_628-4:29923Byte/second,topic_628-5:146249Byte/second,topic_628-6:65305Byte/second,topic_628-7:65539Byte/second,topic_628-8:137614Byte/second,topic_628-9:115191Byte/second,topic_628-10:90444Byte/second,topic_628-11:48565Byte/second,topic_628-12:59104Byte/second,topic_628-13:140369Byte/second,topic_585-0:489215Byte/second,topic_585-1:413122Byte/second,topic_585-2:2333Byte/second,topic_585-3:105268Byte/second,topic_585-4:29435Byte/second,topic_585-5:213112Byte/second,topic_585-6:462634Byte/second,topic_585-7:164418Byte/second,topic_585-8:402241Byte/second,topic_585-9:144981Byte/second,topic_585-10:424393Byte/second,topic_585-11:18237Byte/second,topic_860-0:93506Byte/second,topic_860-1:273703Byte/second,topic_860-2:52541Byte/second,topic_860-3:260830Byte/second,topic_860-4:46206Byte/second,topic_860-5:95305Byte/second,topic_860-6:46450Byte/second,topic_860-7:276870Byte/second,topic_860-8:263870Byte/second,topic_344-0:135860Byte/second,topic_344-1:44707Byte/second,topic_344-2:43907Byte/second,topic_344-3:86154Byte/second,topic_344-4:154848Byte/second,topic_344-5:35497Byte/second,topic_344-6:150418Byte/second,topic_344-7:72610Byte/second,topic_344-8:179780Byte/second,topic_344-9:161726Byte/second,topic_344-10:3114Byte/second,topic_344-11:41304Byte/second,topic_223-0:214145Byte/second,topic_223-1:102462Byte/second,topic_223-2:219026Byte/second,topic_223-3:152217Byte/second,topic_223-4:54874Byte/second,topic_223-5:226168Byte/second,topic_223-6:212653Byte/second,topic_223-7:166562Byte/second,topic_223-8:160056Byte/second,topic_223-9:137860Byte/second,topic_223-10:124208Byte/second,topic_223-11:245435Byte/second,topic_223-12:143545Byte/second,topic_223-13:290575Byte/second,topic_584-0:100906Byte/second,topic_584-1:125130Byte/second,topic_584-2:260952Byte/second,topic_584-3:328784Byte/second,topic_584-4:68463Byte/second,topic_584-5:285723Byte/second,topic_584-6:184458Byte/second,topic_584-7:341745Byte/second,topic_584-8:170775Byte/second,topic_584-9:42605Byte/second,topic_584-10:171735Byte/second,topic_584-11:104945Byte/second,topic_584-12:150448Byte/second,topic_188-0:52498Byte/second,topic_188-1:152211Byte/second,topic_188-2:166161Byte/second,topic_188-3:91299Byte/second,topic_188-4:123662Byte/second,topic_188-5:52863Byte/second,topic_188-6:43719Byte/second,topic_188-7:147740Byte/second,topic_468-0:47472Byte/second,topic_468-1:83683Byte/second,topic_468-2:46232Byte/second,topic_468-3:69100Byte/second,topic_468-4:67705Byte/second,topic_468-5:43143Byte/second,topic_468-6:33274Byte/second,topic_468-7:65034Byte/second,topic_468-8:51386Byte/second,topic_468-9:28383Byte/second,topic_468-10:48267Byte/second,topic_468-11:53669Byte/second,topic_468-12:40974Byte/second,topic_226-0:93571Byte/second,topic_226-1:27131Byte/second,topic_226-2:87429Byte/second,topic_226-3:90130Byte/second,topic_226-4:66708Byte/second,topic_226-5:32975Byte/second,topic_226-6:29046Byte/second,topic_226-7:48440Byte/second,topic_226-8:86988Byte/second,topic_226-9:45860Byte/second,topic_226-10:55620Byte/second,topic_226-11:115652Byte/second,topic_226-12:42309Byte/second,topic_226-13:7495Byte/second,topic_226-14:56211Byte/second,topic_985-0:3668Byte/second,topic_985-1:94378Byte/second,topic_985-2:306Byte/second,topic_985-3:128800Byte/second,topic_985-4:325884Byte/second,topic_985-5:243304Byte/second,topic_985-6:32701Byte/second,topic_985-7:201980Byte/second,topic_985-8:251929Byte/second,topic_985-9:196876Byte/second,topic_985-10:212799Byte/second,topic_623-0:534026Byte/second,topic_623-1:37215Byte/second,topic_623-2:606046Byte/second,topic_623-3:58016Byte/second,topic_623-4:325236Byte/second,topic_623-5:367761Byte/second,topic_623-6:136300Byte/second,topic_986-0:122434Byte/second,topic_986-1:12254Byte/second,topic_986-2:176117Byte/second,topic_986-3:66370Byte/second,topic_986-4:108654Byte/second,topic_986-5:20866Byte/second,topic_986-6:20925Byte/second,topic_986-7:148342Byte/second,topic_986-8:186572Byte/second,topic_986-9:132963Byte/second,topic_986-10:28047Byte/second,topic_986-11:41846Byte/second,topic_103-0:330559Byte/second,topic_103-1:85662Byte/second,topic_103-2:187462Byte/second,topic_103-3:320434Byte/second,topic_103-4:295170Byte/second,topic_103-5:250308Byte/second,topic_103-6:300959Byte/second,topic_103-7:103562Byte/second,topic_103-8:250774Byte/second,topic_103-9:125517Byte/second,topic_500-0:360578Byte/second,topic_500-1:99534Byte/second,topic_500-2:579048Byte/second,topic_500-3:133741Byte/second,topic_500-4:170903Byte/second,topic_500-5:501694Byte/second,topic_500-6:15383Byte/second,topic_500-7:36984Byte/second,topic_500-8:297093Byte/second,topic_500-9:265770Byte/second,topic_500-10:28118Byte/second,topic_467-0:64698Byte/second,topic_467-1:39627Byte/second,topic_467-2:278668Byte/second,topic_467-3:156822Byte/second,topic_467-4:202232Byte/second,topic_467-5:87972Byte/second,topic_467-6:36677Byte/second,topic_467-7:59337Byte/second,topic_467-8:165129Byte/second,topic_467-9:173928Byte/second,topic_467-10:219903Byte/second,topic_467-11:224735Byte/second,topic_467-12:138671Byte/second,topic_467-13:242934Byte/second,topic_193-0:152698Byte/second,topic_193-1:13172Byte/second,topic_193-2:146052Byte/second,topic_193-3:141971Byte/second,topic_193-4:178015Byte/second,topic_193-5:141249Byte/second,topic_193-6:121395Byte/second,topic_193-7:178735Byte/second,topic_191-0:334653Byte/second,topic_191-1:349670Byte/second,topic_191-2:662630Byte/second,topic_191-3:58666Byte/second,topic_191-4:605644Byte/second,topic_472-0:602566Byte/second,topic_472-1:162085Byte/second,topic_472-2:340688Byte/second,topic_472-3:329862Byte/second,topic_472-4:569164Byte/second,topic_472-5:1041Byte/second,topic_472-6:523756Byte/second,topic_90-0:96470Byte/second,topic_90-1:193547Byte/second,topic_90-2:274109Byte/second,topic_90-3:266048Byte/second,topic_90-4:124834Byte/second,topic_90-5:230936Byte/second,topic_90-6:285914Byte/second,topic_470-0:127932Byte/second,topic_470-1:337254Byte/second,topic_470-2:112839Byte/second,topic_470-3:230398Byte/second,topic_470-4:178260Byte/second,topic_470-5:62961Byte/second,topic_470-6:325352Byte/second,topic_470-7:259600Byte/second,topic_470-8:57917Byte/second,topic_470-9:131571Byte/second,topic_470-10:35464Byte/second,topic_470-11:157303Byte/second,topic_470-12:72132Byte/second,topic_92-0:119300Byte/second,topic_92-1:95088Byte/second,topic_92-2:87721Byte/second,topic_92-3:7393Byte/second,topic_92-4:107324Byte/second,topic_92-5:172815Byte/second,topic_92-6:159347Byte/second,topic_92-7:72434Byte/second,topic_92-8:130292Byte/second,topic_92-9:21285Byte/second,topic_92-10:92344Byte/second,topic_96-0:161502Byte/second,topic_96-1:119281Byte/second,topic_96-2:200790Byte/second,topic_96-3:139360Byte/second,topic_96-4:240588Byte/second,topic_96-5:110374Byte/second,topic_96-6:70843Byte/second,topic_96-7:91931Byte/second,topic_96-8:202899Byte/second,topic_96-9:160257Byte/second,topic_96-10:39185Byte/second,topic_96-11:244708Byte/second,topic_96-12:55052Byte/second,topic_96-13:135001Byte/second,topic_96-14:50169Byte/second,topic_616-0:909946Byte/second,topic_616-1:671765Byte/second,topic_616-2:1236538Byte/second,topic_616-3:474738Byte/second,topic_616-4:182662Byte/second,topic_616-5:375579Byte/second,topic_616-6:874261Byte/second,topic_616-7:939939Byte/second,topic_616-8:607372Byte/second,topic_616-9:722583Byte/second,topic_977-0:392910Byte/second,topic_977-1:286535Byte/second,topic_977-2:491326Byte/second,topic_977-3:548688Byte/second,topic_977-4:114912Byte/second,topic_977-5:68872Byte/second,topic_178-0:560662Byte/second,topic_178-1:70031Byte/second,topic_178-2:140536Byte/second,topic_178-3:187735Byte/second,topic_178-4:379068Byte/second,topic_178-5:193050Byte/second,topic_178-6:561230Byte/second,topic_178-7:6173Byte/second,topic_971-0:761546Byte/second,topic_971-1:214756Byte/second,topic_971-2:106854Byte/second,topic_971-3:79365Byte/second,topic_971-4:699128Byte/second,topic_971-5:682228Byte/second,topic_179-0:88577Byte/second,topic_179-1:201155Byte/second,topic_179-2:24161Byte/second,topic_179-3:234896Byte/second,topic_179-4:169550Byte/second,topic_179-5:187925Byte/second,topic_179-6:118047Byte/second,topic_333-0:186885Byte/second,topic_333-1:112136Byte/second,topic_333-2:89778Byte/second,topic_333-3:125423Byte/second,topic_333-4:147204Byte/second,topic_333-5:64271Byte/second,topic_333-6:179427Byte/second,topic_333-7:92998Byte/second,topic_333-8:1859Byte/second,topic_333-9:172365Byte/second,topic_333-10:217168Byte/second,topic_215-0:179751Byte/second,topic_215-1:70903Byte/second,topic_215-2:59957Byte/second,topic_215-3:347629Byte/second,topic_215-4:156570Byte/second,topic_215-5:147148Byte/second,topic_215-6:139188Byte/second,topic_215-7:182488Byte/second,topic_215-8:131458Byte/second,topic_215-9:128831Byte/second,topic_699-0:264162Byte/second,topic_699-1:402155Byte/second,topic_699-2:610793Byte/second,topic_699-3:357057Byte/second,topic_699-4:657781Byte/second,topic_699-5:148678Byte/second,topic_699-6:357446Byte/second,topic_699-7:500140Byte/second,topic_699-8:206631Byte/second,topic_579-0:691648Byte/second,topic_579-1:344698Byte/second,topic_579-2:270291Byte/second,topic_579-3:624424Byte/second,topic_579-4:517169Byte/second,topic_579-5:291103Byte/second,topic_579-6:293317Byte/second,topic_731-0:523073Byte/second,topic_731-1:367980Byte/second,topic_731-2:538903Byte/second,topic_731-3:323383Byte/second,topic_731-4:200166Byte/second,topic_731-5:504790Byte/second,topic_731-6:467475Byte/second,topic_731-7:278904Byte/second,topic_731-8:95353Byte/second,topic_731-9:33933Byte/second,topic_731-10:82376Byte/second,topic_731-11:331314Byte/second,topic_182-0:8091Byte/second,topic_182-1:35518Byte/second,topic_182-2:83789Byte/second,topic_182-3:58538Byte/second,topic_182-4:96218Byte/second,topic_182-5:115237Byte/second,topic_182-6:23095Byte/second,topic_182-7:80234Byte/second,topic_182-8:86111Byte/second,topic_182-9:22544Byte/second,topic_182-10:68827Byte/second,topic_460-0:768335Byte/second,topic_460-1:770315Byte/second,topic_460-2:368635Byte/second,topic_460-3:116769Byte/second,topic_460-4:765489Byte/second,topic_582-0:291398Byte/second,topic_582-1:445216Byte/second,topic_582-2:510549Byte/second,topic_582-3:229498Byte/second,topic_582-4:45006Byte/second,topic_582-5:566390Byte/second,topic_582-6:579422Byte/second,topic_582-7:638815Byte/second,topic_582-8:424244Byte/second,topic_582-9:626846Byte/second,topic_582-10:475137Byte/second,topic_582-11:551497Byte/second,topic_582-12:433092Byte/second,topic_184-0:175768Byte/second,topic_184-1:154631Byte/second,topic_184-2:1790Byte/second,topic_184-3:936863Byte/second,topic_184-4:861027Byte/second,topic_184-5:23813Byte/second --producers 16 --consumers 24 --run.until 1day --key.size 10KiB --key.distribution zipfian --bootstrap.servers 192.168.103.177:25655,192.168.103.178:25655,192.168.103.179:25655,192.168.103.180:25655,192.168.103.181:25655,192.168.103.182:25655

他嘗試對 1627 個 Partition 進行對應速度的 throttle,該生成結果預期 Performance Client 會輸出 359 MB/s 的資料量,但實際上 Performance Client 只有輸出 30 MB/s 上下的吞吐量,然後跑 Performance 的設備有 CPU 資源用盡的跡象。

image

@garyparrot garyparrot marked this pull request as ready for review February 5, 2023 08:42
@garyparrot
Copy link
Collaborator Author

目前 Performance Tool 生成的指令在執行上會有一些效能的問題

我後面會去追看看這個問題

@chia7712
Copy link
Contributor

chia7712 commented Feb 5, 2023

他嘗試對 1627 個 Partition 進行對應速度的 throttle,該生成結果預期 Performance Client 會輸出 359 MB/s 的資料量,但實際上 Performance Client 只有輸出 30 MB/s 上下的吞吐量,然後跑 Performance 的設備有 CPU 資源用盡的跡象。

大概有大量的collection操作太操,如果這是嚴重的技術問題(例如單機上操作的瓶頸),我們就要逐步移動到使用分散式版本的perf (see https://github.com/skiptests/astraea/blob/main/docs/connector/performance_banchmark_connector.md)

不過該分散式版本功能還很陽春 @@

@chia7712
Copy link
Contributor

chia7712 commented Feb 5, 2023

我後面會去追看看這個問題

可否先開議題?

@garyparrot
Copy link
Collaborator Author

garyparrot commented Feb 8, 2023

其他普通 topic 的流量問題解決了,現在剩 backbone topic 沒辦法打到 500 MB/s 的速度,目前專門分一個 performance client 來做這件事情也沒辦法做到那麼快速的傳輸,我這邊能做到的最大速度是 300 MB/s 的寫入和 100 MB/s 的讀取。backbone topic 和其他 topic 的主要差異除了流量高之外還有他只有一個 partition,我猜可能是撞到 partition 速度的物理限制?

晚點會嘗試看看其他方法,看能不能做到 500 MB/s 的傳輸

image

@garyparrot
Copy link
Collaborator Author

晚點會嘗試看看其他方法,看能不能做到 500 MB/s 的傳輸

剛剛確認過了,應該是卡到底下硬碟讀寫的頻寬,我記得那幾臺設備的 SSD 寫入速度最高可以到 500 MB/s 附近,但查核點的測試環境下,backbone topic 自己就會佔據掉 500 MB/s 的讀寫,其中一個 SSD 還要承受同個 broker 中另外 500 個小 partition 的流量,這樣前後加總起來,目前的設備應該是很難在沒有人為介入的情況下重現查核點的情境。

目前可能的做法有

  • 直接改查核點的內容,設計成目前的 SSD 可以容納的情境。
  • 人為介入,確保 backbone topic 只會佔用一個 broker,但同時查核點可能背後會多一個要負載平衡的項目:Data Folder 間的流量。
  • 替換成更頂的 SSD (需要買 6 * 3 = 18 個寫入速度更好的 SSD)

@chia7712 你覺得這些解決方案如何,我覺得第一個應該是最簡單的做法,但我不知道文件出去了沒還能不能改。

@chia7712
Copy link
Contributor

chia7712 commented Feb 9, 2023

直接改查核點的內容,設計成目前的 SSD 可以容納的情境。

文件還沒出去,你們的報告改到二月底了(等其他人)

不過可以先提一下你打算改成哪樣的數字

1. Increase the number of backbone partiiton to 24.
2. Disable zero fanout since performance tool doesn't support it.
@garyparrot
Copy link
Collaborator Author

garyparrot commented Feb 9, 2023

不過可以先提一下你打算改成哪樣的數字

變更有3項:

  • Backbone Topic 的 Partition 數量由 1 增長到 24 個
  • Backbone Topic 的 Partition 流量會不一,且其分佈會導致負載不平衡
  • 普通 Topic 的 Consumer Fanout 從介於 0 ~ 3 變成 1 ~ 3

比較有爭議的改變是第二項,第二項是說肯定會有負載不平衡的情況發生,這個是透過在 Scenario 內刻意調整 Partition 在某些節點的流量來達成的,之所以要這樣做是因為 Kafka 的設計不一定會負載不平衡,這邊透過腳本刻意的方式,確保負載不平衡的情境會發生。這種流量分佈在生產環境是真的有可能會發生,只是發生的可能性是一個機率,然後這邊就是假設這個運氣不好的機率真的成真。在這個假設下去做負載平衡。

第三項是因為 Performance Tool 對無 consumer 的情境支援有些困難,所以這邊直接改成 topic 一定會有 consumer。

目前測試 BackboneImbalanceScenario,他能夠打出想要的情境,只是有些許的誤差。

image

  • 節點應承受的 Producer 流量會有大約 2 MB/s 的誤差
  • 節點應承受的 Consumer 流量會有大約 8 MB/s 的誤差

@garyparrot
Copy link
Collaborator Author

garyparrot commented Feb 10, 2023

嘗試使用 Zipfian 來製造負載不平衡的情境

image

目前發現到的問題有

  1. Zipfian 的輸出的流量不太穩定 (Performance NIC Produce 圖中的綠色線段)。
  2. Zipfian 營造出來的負載不平衡結果變化很大,比如 A 最大的差距約 200 MB,但 C 最大的差距約 100 MB。
  3. Zipfian 有機會撞到 Disk 讀寫的瓶頸

關於第一點的部分

image

我嘗試把其他 Perf 關掉,然後 Zipfian 那臺的流量有變穩定的趨勢,我覺得是遇到 SSD 讀寫上的瓶頸,有些時候 SSD 讀寫到達 500 MB/s 附近。

如果用 Zipfian 做實驗的時候可能意外會比較多(太多變數),我在想能不能在實驗之前先用 Zipfian 分佈生成流量,確定流量不會造成實驗環境的瓶頸之後,把對應的值用 throttle 去限制(類似上面 #1476 (comment) 提出的做法,只是換個故事說這件事情)

@garyparrot
Copy link
Collaborator Author

另外一個做法是把整體流量壓下去,不要打到現在 500 MB 到 700 MB 那麼高,可能把流量控制在比如 200 MB 到 500 MB 之間,這樣實驗的執行會能夠比較穩定

@chia7712
Copy link
Contributor

我嘗試把其他 Perf 關掉,然後 Zipfian 那臺的流量有變穩定的趨勢,我覺得是遇到 SSD 讀寫上的瓶頸,

撞到硬體的上限並不是什麼意外(這很正常),反之,這更是一個好的情境,可以說在這種狀況下有大量資源浪費(撞到上限可能導致 retry or 其他 overhead),而透過你設計的 balancer 可以有效平衡負載讓各個資料流避免撞到硬體上限

如果用 Zipfian 做實驗的時候可能意外會比較多(太多變數

同上

@garyparrot
Copy link
Collaborator Author

撞到硬體的上限並不是什麼意外(這很正常),反之,這更是一個好的情境

不過這樣負載平衡演算法會很難做,我們是基於過去的效能指標來判斷 Partition 背後的負載量,可能因為撞到硬體上限而難以估計一個 Partition 背後真正的負載量是多少(比如他的值一直彈跳,誤會真正的負載值,或是以為 Partition A 的負載量是 100 MB/s,但搬移完成後硬體上限問題不存在,Partition A 的負載量長到原本應該輸入的 150 MB/s,造成最後的結果依然負載不平衡)

@chia7712
Copy link
Contributor

不過這樣負載平衡演算法會很難做,我們是基於過去的效能指標來判斷 Partition 背後的負載量,可能因為撞到硬體上限而難以估計一個 Partition 背後真正的負載量是多少(比如他的值一直彈跳,誤會真正的負載值,或是以為 Partition A 的負載量是 100 MB/s,但搬移完成後硬體上限問題不存在,Partition A 的負載量長到原本應該輸入的 150 MB/s,造成最後的結果依然負載不平衡)

這就是真實有意義且有挑戰感的題目了不是嗎 :) 我們的 cost function 的目標就是要能克服這些真實且會發生的狀況,像你現在說到的這個現象,你能否找到一個數學的方式來減輕“誤判”,這樣就會是既有理論又有實際意義的題目

但如果是為了查核項目方便,我會建議可以考慮用壓縮來減緩 I/O

@garyparrot
Copy link
Collaborator Author

我會建議可以考慮用壓縮來減緩 I/O

image

我使用 kafka server side compression 壓縮,不過好像對 zipfian 的流量有影響

我可能會改用減少其他 topic 的流量的方式來確保穩定性

image

查核情境的修改:

  • 每個普通 topic 的流量平均: 3MB/s -> 1.5MB/s
  • 骨幹 Topic 的流量 950 MB/s ± 20%
  • 骨幹 Topic 的 Partition 數量 24
  • 骨幹 Topic 的 key 存在分佈不平衡的趨勢
  • 普通 Topic 的 Consumer Fanout: 0 ~ 3 -> 1 ~ 6

@chia7712
Copy link
Contributor

查核情境的修改:

從上次討論的結果來看,情境已經有些變化,我們回原本的議題討論,也麻煩你試著修改 #1424 的描述,把情境的部分也重寫一次。

@garyparrot
Copy link
Collaborator Author

從上次討論的結果來看,情境已經有些變化,我們回原本的議題討論,也麻煩你試著修改 #1424 的描述,把情境的部分也重寫一次。

已修改,這隻 PR 的情境生成程式碼我需要再做一下修正,後面測試穩定後大致上就完成了

@garyparrot
Copy link
Collaborator Author

garyparrot commented Feb 22, 2023

Metrics 量太大導致計算時間增加嗎?

Network Cost 現在只單看一個時間點的 metrics,還沒把整個時間軸的數據都攤開。

是你說的那句“不管是看一個或整個時間軸 跟計算所需的時間有關聯嗎"嗎?我可能沒有看懂可以多解釋壹下嗎

NetworkCost 現在只衡量 t 一個時間點的 metrics,還沒有做到像未來 NetworkHotspotCost 要衡量 [t, t + l] 時間的 metrics 這種等級的計算複雜度,所以我覺得 NetworkCost 會慢的原因不是因為 "一個 Partition 涉及的 metrics 的計算太多",而是 "Partition 數量太多" 沒辦法在我們常用的計劃生成時間(30秒)下得出一個好的優化計劃。

從火焰圖來看算成本是花很多時間,那麼花很多時間的關鍵點是什麼

  • NetworkCost#updateCurrentClsuter 佔據大約整體 8% 時間,這邊在目前輸入的 ClusterInfo 是不是 inital cluster
  • NetworkCost#estimateRate 這個部分在預估每個 Partition 的負載大小,佔據整體 26.71%
    • 其中 20% 的時間用來總統計預估的計算
    • 其中 6% 的時間用來一些負載關係的整理
  • NetworkCost#clusterCost 裡面的 統整每個節點的 DataRate 這個部分佔據整體 13.47%

上面這些工作量都和 Partition 數量有關。用 #1502 的程式碼對不同 Partition 數量的叢集做優化,可以看出這個 Partition 數量和執行時間之間的趨勢。他們有著非常高的正相關。

叢集 Partitions 數量 每次衡量 Cluster Cost 耗費的平均時間 在 30秒優化中衡量 Cluster Cost Func 的次數
10000 136ms 118
5000 58ms 263
1000 11ms 1296
100 ~0ms 16447

所以花太多時間的關鍵點應該是 Partition 數量太多沒辦法在現行的實作 & 30 秒內得到好的計劃。

@chia7712
Copy link
Contributor

所以花太多時間的關鍵點應該是 Partition 數量太多沒辦法在現行的實作 & 30 秒內得到好的計劃。

ok,不過這一段應該會在 #1508 後有一個明顯的改動,我們可以先不急著追求既有程式碼的優化。或者說應該先完成 #1508 後再來看是否有一樣的效能議題,然後在 #1508 的基礎下進行調整

@garyparrot
Copy link
Collaborator Author

garyparrot commented Mar 4, 2023

#1508 的修正似乎讓速度變更慢

image

image

套用 ClusterInfoSensor 後,算法進步的速度慢了大約 100 倍。火焰圖指出有 3/4 比例的時間都在計算 ClusterInfoSensor#metricViewCluster

@chia7712
Copy link
Contributor

chia7712 commented Mar 4, 2023

@garyparrot 這回到我們上次討論的,量和值有時候就是trade off,看你想要往哪邊用力

@garyparrot
Copy link
Collaborator Author

效能問題解得差不多後嘗試進行實驗,目前發現的幾個問題

Zipfian 的 Consumer 吞吐量追不上

Zipfian 分佈下的 Producer/Consumer 有非常顯著的 "Produce 寫入流量 > Consume 讀取流量" 的問題,這個現象導致目前查核點的情境沒辦法被準確呈現。

image

上圖所有 parititon 的 consumer fanout 都是 1,理論上節點的輸入和輸出流量要長得一致,但負責 zipfian 最熱門的那個 partition 的 broker 的 egress 流量特別低 (右邊紅色)。去 performance tool 輸出也能看到 consumer 的總消費吞吐量輸 produce 約 100 MB/s 附近。

透過連線進去看 Consumer 的 Lag 資訊,可以看到有些比較熱門的 Partition 有非常顯著的 lag:

image

上圖的 Consumer Partition 大約堆積了 76 GB 的資料還沒消費(10KB per record)

Zipfian 的 Performance Tool 在負載優化後速度降低

image

這個應該也是 consumer lag 造成的,目前還不確定 Consumer 吞吐的下降原因。

NetworkCost 流量預估不準確

Initial Cost: WeightCompositeClusterCost[{"NetworkIngressCost" cost 0.03792682892185111 weight 3.0 description {417.18 MB/seconds, 434.34 MB/seconds, 433.15 MB/seconds, 429.81 MB/seconds, 546.48 MB/seconds, 466.01 MB/seconds} }, {"ReplicaNumberCost" cost 0.0023148148148148147 weight 1.0 description LongSummaryStatistics{count=6, sum=9936, min=1646, average=1656.000000, max=1669} }, {"NetworkEgressCost" cost 0.006618972192553504 weight 0.0 description {552.49 MB/seconds, 573.62 MB/seconds, 575.05 MB/seconds, 568.12 MB/seconds, 569.87 MB/seconds, 570.08 MB/seconds} }] = 0.029023825395092035

ClusterCost 裡面某些節點的流量值和監控上看到的情況不一致,裡面的計算可能有些誤差存在 (約 50MB/s)

@chia7712
Copy link
Contributor

chia7712 commented Apr 1, 2023

回頭看了一下這隻PR,幾個疑問:

他可以透過 Web API 的形式來對叢集套用特定的情境。然後將 Scenario 回傳的資訊以 JSON 回覆給使用者。

請問這邊的套用是指什麼?

回覆的資訊包含

這些功能除了查核驗收以外, production 上有機會使用嗎?

@garyparrot
Copy link
Collaborator Author

請問這邊的套用是指什麼?

#1424 的情境建立在叢集上,比如那 10000 個 Partition

回覆的資訊包含

這些功能除了查核驗收以外, production 上有機會使用嗎?

我想沒有辦法在 production 上用,這些 scenario 都是實驗用途。

這 PR 主要是實驗的程式碼和工具要推上來方便重現。另外除了這個 PR 的建立情境之外,還有一段是把情境的 Performance Tool 開起來,因為那個部分會牽涉很多東西,所以沒有打算推上,我想這部分可以靠其他人閱讀 scenario output 來手動建起來。

如果說這些功能要避免出現在 production 的話,那 SkewedPartitionScenario 可以要撤下來,他現在有出現在建立 topic 的 WEB API 上面

@chia7712
Copy link
Contributor

chia7712 commented Apr 2, 2023

這 PR 主要是實驗的程式碼和工具要推上來方便重現。另外除了這個 PR 的建立情境之外,還有一段是把情境的 Performance Tool 開起來,因為那個部分會牽涉很多東西,所以沒有打算推上,我想這部分可以靠其他人閱讀 scenario output 來手動建起來。如果說這些功能要避免出現在 production 的話,那 SkewedPartitionScenario 可以要撤下來,他現在有出現在建立 topic 的 WEB API 上面

我們還是稍微區分一下 production code 和 驗收的項目。

驗收的項目可以先用獨立的專案放著,然後其中涉及到production 變更 或是 需求的部分再推到官方專案上

@garyparrot
Copy link
Collaborator Author

驗收的項目可以先用獨立的專案放著,然後其中涉及到production 變更 或是 需求的部分再推到官方專案上

ok 那這個 PR 的內容就不考慮合併了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants