Part 3 : Conclusion on Single vs Multiple data stream

Anirudha | Sat, 09/21/2019 - 15:27
S3uploaddownload
Conclusion
  • Your application may be OK with single stream.
  • Using multiple streams can give you better throughput. 
  • But make sure 
    • Size your AOS cluster and Objects cluster properly.
    • Use right platform for deployment.
    • Objects cluster is configured with at least 10GB network speed, higher network speed (25G or 40G) is recommended if you want high throughput.
    • Deploy right size Objects cluster for your workload.
    • You have good network speed between your client to Objects cluster.
    • Your cluster client is capable of pushing data in multiple streams.
  • Experiment with single stream and increase the number of streams linearly, to know how much you should push in your environment.
  • If you plan to use multiple applications on same Objects cluster, then make sure you dont over configure each application.