BlockIo2 Protocol test tool

BlockIo2 Protocol test tool

[Sajeesh Kk]

Hello all,

I have a prototype BlockIO2 protocol implementation. Are there any
independent tools available to test this out ?. Please let me know.

Thanks,
Sajeesh.

Re: BlockIo2 Protocol test tool

[Rafael Machado]

Hi Sajeesh

Probably you can use UEFI Sct for this test.
http://uefi.org/testtools

Thanks and Regards
Rafael Machado

Em sáb, 26 de jan de 2019 00:24, Sajeesh Kk <sajee.kk@gmail.com escreveu:

> Hello all,
>
> I have a prototype BlockIO2 protocol implementation. Are there any
> independent tools available to test this out ?. Please let me know.
>
> Thanks,
> Sajeesh.
> _______________________________________________
> edk2-devel mailing list
> edk2-devel@lists.01.org
> https://lists.01.org/mailman/listinfo/edk2-devel
>

Re: BlockIo2 Protocol test tool

[Sajeesh Kk]

Hello Rafeal,

I believe The UEFI Sct test suite cannot be used for performance testing.
Are there any tools which can be used from UEFI shell to measure disk IO
perfomance using BlockIO2 Protocol ?
Please let me know.

Thanks,
Sajeesh.

On Sat, Jan 26, 2019 at 9:39 PM Rafael Machado <
rafaelrodrigues.machado@gmail.com> wrote:

> Hi Sajeesh
>
> Probably you can use UEFI Sct for this test.
> http://uefi.org/testtools
>
> Thanks and Regards
> Rafael Machado
>
> Em sáb, 26 de jan de 2019 00:24, Sajeesh Kk <sajee.kk@gmail.com escreveu:
>
>> Hello all,
>>
>> I have a prototype BlockIO2 protocol implementation. Are there any
>> independent tools available to test this out ?. Please let me know.
>>
>> Thanks,
>> Sajeesh.
>> _______________________________________________
>> edk2-devel mailing list
>> edk2-devel@lists.01.org
>> https://lists.01.org/mailman/listinfo/edk2-devel
>>
>

Re: BlockIo2 Protocol test tool

[Rafael Machado]

Hi Sajeesh

I don't now of any tool with this purpose.

Rafael

Em sáb, 26 de jan de 2019 13:57, Sajeesh Kk <sajee.kk@gmail.com escreveu:

> Hello Rafeal,
>
> I believe The UEFI Sct test suite cannot be used for performance testing.
> Are there any tools which can be used from UEFI shell to measure disk IO
> perfomance using BlockIO2 Protocol ?
> Please let me know.
>
> Thanks,
> Sajeesh.
>
> On Sat, Jan 26, 2019 at 9:39 PM Rafael Machado <
> rafaelrodrigues.machado@gmail.com> wrote:
>
>> Hi Sajeesh
>>
>> Probably you can use UEFI Sct for this test.
>> http://uefi.org/testtools
>>
>> Thanks and Regards
>> Rafael Machado
>>
>> Em sáb, 26 de jan de 2019 00:24, Sajeesh Kk <sajee.kk@gmail.com escreveu:
>>
>>> Hello all,
>>>
>>> I have a prototype BlockIO2 protocol implementation. Are there any
>>> independent tools available to test this out ?. Please let me know.
>>>
>>> Thanks,
>>> Sajeesh.
>>> _______________________________________________
>>> edk2-devel mailing list
>>> edk2-devel@lists.01.org
>>> https://lists.01.org/mailman/listinfo/edk2-devel
>>>
>>

Re: BlockIo2 Protocol test tool

[Laszlo Ersek]

Hi,

On 01/26/19 17:57, Sajeesh Kk wrote:
> Hello Rafeal,
> 
> I believe The UEFI Sct test suite cannot be used for performance testing.
> Are there any tools which can be used from UEFI shell to measure disk IO
> perfomance using BlockIO2 Protocol ?
> Please let me know.

from a cursory look, FatPkg/EnhancedFatDxe appears to implement the the
ReadEx/WriteEx methods of EFI_FILE_PROTOCOL
(EFI_FILE_PROTOCOL_REVISION2). I think the implementation uses the
DiskIo2 protocol.

And "MdeModulePkg/Universal/Disk/DiskIoDxe" should automatically install
DiskIo2 on top of your BlockIo2.

So, if you can write a simple UEFI application that uses the *Ex()
methods of EFI_FILE_PROTOCOL, that could be a start. (Nothing in edk2
seems to use ReadEx / WriteEx currently.)

Thanks,
Laszlo

Re: BlockIo2 Protocol test tool

[Sajeesh Kk]

Hello Laszlo,

Thanks for the quick response. I have some doubts regarding
"TransactionStatus" that should be signaled by the driver when an IO
operation is completed. If my understanding is not correct please educate.

1. As per UEFI spec, the error codes EFI_DEVICE_ERROR, EFI_NO_MEDIA,
EFI_MEDIA_CHANGED or EFI_WRITE_PROTECTED should not be signaled when non
Blocking IO is being used. so if an IO fails, the driver should not signal
the event as per the spec. if this is the case,
    the event should be signaled only when IO is completed successfully ?
2. If the driver does not have enough resources to complete an IO request,
the driver should signal the event with same status (EFI_OUT_OF_RESOURCES)
so that caller will retry the IO ? In such cases, what should be the status
of  ReadEx/WriteEx callbacks itself that should returned to the caller ?

In short, i am bit confused what should be the "Transaction Status" that
should be signaled by the driver. Please comment.

Thanks,
Sajeesh.



On Mon, Jan 28, 2019 at 2:17 PM Laszlo Ersek <lersek@redhat.com> wrote:

> Hi,
>
> On 01/26/19 17:57, Sajeesh Kk wrote:
> > Hello Rafeal,
> >
> > I believe The UEFI Sct test suite cannot be used for performance testing.
> > Are there any tools which can be used from UEFI shell to measure disk IO
> > perfomance using BlockIO2 Protocol ?
> > Please let me know.
>
> from a cursory look, FatPkg/EnhancedFatDxe appears to implement the the
> ReadEx/WriteEx methods of EFI_FILE_PROTOCOL
> (EFI_FILE_PROTOCOL_REVISION2). I think the implementation uses the
> DiskIo2 protocol.
>
> And "MdeModulePkg/Universal/Disk/DiskIoDxe" should automatically install
> DiskIo2 on top of your BlockIo2.
>
> So, if you can write a simple UEFI application that uses the *Ex()
> methods of EFI_FILE_PROTOCOL, that could be a start. (Nothing in edk2
> seems to use ReadEx / WriteEx currently.)
>
> Thanks,
> Laszlo
>

Re: BlockIo2 Protocol test tool

[Laszlo Ersek]

On 02/02/19 08:05, Sajeesh Kk wrote:
> Hello Laszlo,
> 
> Thanks for the quick response. I have some doubts regarding
> "TransactionStatus" that should be signaled by the driver when an IO
> operation is completed. If my understanding is not correct please educate.
> 
> 1. As per UEFI spec, the error codes EFI_DEVICE_ERROR, EFI_NO_MEDIA,
> EFI_MEDIA_CHANGED or EFI_WRITE_PROTECTED should not be signaled when non
> Blocking IO is being used. so if an IO fails, the driver should not signal
> the event as per the spec. if this is the case,
>     the event should be signaled only when IO is completed successfully ?

My understanding is that there are three cases:

(1) The IO completes successfully. In this case, the completion
notification is asynchronous (i.e., the event is signaled)

(2) The IO fails, and the BlockIo2 driver determines the failure
asynchronously. In this case, the original call returns EFI_SUCCESS, and
the error notification occurs again via signaling the event.

(3) The IO fails, but the failure is determined immediately
(synchronously), as part of the original call. In this case, no
background operation is queued (so there is nothing to signal an event
for later), and the error is returned immediately.


IMO, the spec requires the driver to check for the EFI_NO_MEDIA and the
EFI_MEDIA_CHANGED conditions *at least* synchronously, that is, to
return them (if they occur) *at least* as case (3).

Regarding EFI_DEVICE_ERROR, I think the driver is free to check for that
only asynchronously, when the actual attempt is being made, in the
background, to work with the device. Therefore, EFI_DEVICE_ERROR may be
reported both as case (2) and as case (3). What's important is that,
*if* the driver reports EFI_DEVICE_ERROR synchronously (3), then the
signaling (case (2)) should not occur -- as it would be redundant.

In summary:
- we have three cases about status reporting,
- some error codes *must* be checked-for synchronously (at least),
- some other error codes may be identified both synchronously and
asynchronously; in either case, they should be reported accordingly.


> 2. If the driver does not have enough resources to complete an IO request,
> the driver should signal the event with same status (EFI_OUT_OF_RESOURCES)
> so that caller will retry the IO ? In such cases, what should be the status
> of  ReadEx/WriteEx callbacks itself that should returned to the caller ?

IMO, the same logic applies to EFI_OUT_OF_RESOURCES as to
EFI_DEVICE_ERROR. If the driver sees immediately that it has lacking
resources, it should return EFI_OUT_OF_RESOURCES immediately. (For
example, if it lacks resources for even *queueing* the request, this
would be the right thing to do.) If the driver realizes only during
background processing that it has run out of resources, then
EFI_OUT_OF_RESOURCES should be returned through the token, asynchronously.

Note that EFI_OUT_OF_RESOURCES is documented as "The request could not
be *completed* due to a lack of resources". This includes both cases
above. (I.e., couldn't be queued, or could be queued, but not
completed.) Therefore both cases (2) and (3) apply, dependent on what
happens.

Now, whether a BlockIo2 driver tries to allocate all *possibly*
necessary resources in advance, when queueing a request, is a
Quality-of-Implementation question, IMO. I think it's not required by
the spec, but it could benefits user experience, and debugging too.
Synchronous error reports save higher level drivers the burden of async
context restoration and recovery --> fewer bugs hit by the user. Also,
it helps with debugging: the developer will get a usable call stack when
the issue hits.

OTOH, if a driver tries too hard to synchronously allocate all possibly
necessary resources for a request, even if there's a good chance that
part of those resources will never be used, then it's a waste. It could
cause other drivers to run out of resources, or it could fail some
requests that would otherwise complete fine in practice.

So it's up to your device & driver whether you should report
EFI_OUT_OF_RESOURCES *only* synchronously. I think it's valid to report
it asynchronously too.

> In short, i am bit confused what should be the "Transaction Status" that
> should be signaled by the driver. Please comment.

Hopefully the above helps.

Thanks,
Laszlo

> On Mon, Jan 28, 2019 at 2:17 PM Laszlo Ersek <lersek@redhat.com> wrote:
> 
>> Hi,
>>
>> On 01/26/19 17:57, Sajeesh Kk wrote:
>>> Hello Rafeal,
>>>
>>> I believe The UEFI Sct test suite cannot be used for performance testing.
>>> Are there any tools which can be used from UEFI shell to measure disk IO
>>> perfomance using BlockIO2 Protocol ?
>>> Please let me know.
>>
>> from a cursory look, FatPkg/EnhancedFatDxe appears to implement the the
>> ReadEx/WriteEx methods of EFI_FILE_PROTOCOL
>> (EFI_FILE_PROTOCOL_REVISION2). I think the implementation uses the
>> DiskIo2 protocol.
>>
>> And "MdeModulePkg/Universal/Disk/DiskIoDxe" should automatically install
>> DiskIo2 on top of your BlockIo2.
>>
>> So, if you can write a simple UEFI application that uses the *Ex()
>> methods of EFI_FILE_PROTOCOL, that could be a start. (Nothing in edk2
>> seems to use ReadEx / WriteEx currently.)
>>
>> Thanks,
>> Laszlo
>>
>